2026-01-28 17:00:03 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 17:00:03 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 17:00:03 [auto1.es] INFO: Starting spider auto1.es
2026-01-28 17:00:03 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 17:00:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 17:00:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 17:00:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 17:00:04 [scrapy.extensions.telnet] INFO: Telnet Password: 060035cc4bef2aad
2026-01-28 17:00:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-01-28 17:00:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.es/task_25_2026-01-28T17_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-01-28 17:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 17:00:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 17:00:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 17:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 17:00:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 17:00:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 17:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:04 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 17:00:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 17:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:04 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-01-28 17:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-01-28 17:00:04 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 17:00:04 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 17:00:04 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 17:00:04 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 17:00:04 [scrapy.core.engine] INFO: Spider opened
2026-01-28 17:00:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 17:00:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-01-28 17:00:04 [scrapy-playwright] INFO: Starting download handler
2026-01-28 17:00:04 [scrapy-playwright] INFO: Starting download handler
2026-01-28 17:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-01-28 17:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-01-28 17:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-01-28 17:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-01-28 17:00:13 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:13 [auto1.es] INFO: Found listing with ID: UF75350
2026-01-28 17:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF75350%27 HTTP/1.1" 200 None
2026-01-28 17:00:13 [auto1.es] INFO: Scrape type for UF75350: 0
2026-01-28 17:00:13 [auto1.es] INFO: Found listing with ID: DX79549
2026-01-28 17:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX79549%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for DX79549: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: AH93641
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH93641%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for AH93641: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: MX49357
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX49357%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for MX49357: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: TM34191
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM34191%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for TM34191: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: FX73472
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX73472%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for FX73472: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: CZ20129
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for CZ20129: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: BY48993
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY48993%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for BY48993: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: WX23991
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX23991%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for WX23991: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: LY33885
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY33885%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for LY33885: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: XS30477
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS30477%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for XS30477: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: EG37952
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG37952%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for EG37952: 2
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: BF10969
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF10969%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for BF10969: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: UA78056
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for UA78056: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: WL01160
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL01160%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for WL01160: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: KJ07748
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for KJ07748: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: GW13583
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW13583%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for GW13583: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: GR14837
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR14837%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for GR14837: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: ZS15160
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS15160%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for ZS15160: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: ZY55990
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY55990%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for ZY55990: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: WE66422
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE66422%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for WE66422: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: HJ32619
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ32619%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for HJ32619: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: WW33546
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33546%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for WW33546: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: VU10076
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU10076%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for VU10076: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: ZC42909
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC42909%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for ZC42909: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: UF82810
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF82810%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for UF82810: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: FF54775
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF54775%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for FF54775: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: HA44926
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA44926%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for HA44926: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: CS90007
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS90007%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for CS90007: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: GF32927
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF32927%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for GF32927: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: TP05677
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP05677%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for TP05677: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: YC43359
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43359%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for YC43359: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: KD97455
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD97455%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for KD97455: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: YR67530
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR67530%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for YR67530: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: LC08667
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC08667%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for LC08667: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: YE57491
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE57491%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for YE57491: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: SH74673
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH74673%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for SH74673: 2
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: VX73239
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX73239%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for VX73239: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: MY54875
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY54875%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for MY54875: 0
2026-01-28 17:00:14 [auto1.es] INFO: Found listing with ID: EW49627
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW49627%27 HTTP/1.1" 200 None
2026-01-28 17:00:14 [auto1.es] INFO: Scrape type for EW49627: 0
2026-01-28 17:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DX79549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX49357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:15 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: UF75350
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF75350%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for UF75350: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: DX79549
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX79549%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for DX79549: 2
2026-01-28 17:00:15 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/DX79549/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: AH93641
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH93641%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for AH93641: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: MX49357
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX49357%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for MX49357: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: TM34191
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM34191%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for TM34191: 2
2026-01-28 17:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX73472/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: FX73472
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX73472%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for FX73472: 2
2026-01-28 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY33885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: CZ20129
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for CZ20129: 2
2026-01-28 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: BY48993
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY48993%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for BY48993: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: WX23991
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX23991%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for WX23991: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: LY33885
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY33885%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for LY33885: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: XS30477
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS30477%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for XS30477: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: EG37952
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG37952%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for EG37952: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: BF10969
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF10969%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for BF10969: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: UA78056
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UA78056%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for UA78056: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: WL01160
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL01160%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for WL01160: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: KJ07748
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for KJ07748: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: GW13583
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW13583%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for GW13583: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: GR14837
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR14837%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for GR14837: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: ZS15160
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS15160%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for ZS15160: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: ZY55990
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZY55990%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for ZY55990: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: WE66422
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE66422%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for WE66422: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: HJ32619
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HJ32619%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for HJ32619: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: WW33546
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW33546%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for WW33546: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: VU10076
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VU10076%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for VU10076: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: ZC42909
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC42909%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for ZC42909: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: UF82810
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF82810%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for UF82810: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: FF54775
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF54775%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for FF54775: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: HA44926
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA44926%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for HA44926: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: CS90007
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS90007%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for CS90007: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: GF32927
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF32927%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for GF32927: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: TP05677
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP05677%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for TP05677: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: YC43359
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43359%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for YC43359: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: KD97455
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD97455%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for KD97455: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: YR67530
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR67530%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for YR67530: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: LC08667
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC08667%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for LC08667: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: YE57491
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE57491%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for YE57491: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: SH74673
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH74673%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for SH74673: 2
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: VX73239
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX73239%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for VX73239: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: MY54875
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY54875%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for MY54875: 0
2026-01-28 17:00:15 [auto1.es] INFO: Found listing with ID: EW49627
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW49627%27 HTTP/1.1" 200 None
2026-01-28 17:00:15 [auto1.es] INFO: Scrape type for EW49627: 0
2026-01-28 17:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG37952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL01160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GW13583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ07748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS15160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE66422/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH93641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CZ20129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM34191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF54775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH74673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC08667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DX79549> (referer: https://www.auto1.com/v1/car-details-view/DX79549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 521a6b23-285e-5e7d-95e6-f629618a3143 with identifier: DX79549
2026-01-28 17:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 521a6b23-285e-5e7d-95e6-f629618a3143 with scrape type 2
2026-01-28 17:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 521a6b23-285e-5e7d-95e6-f629618a3143 with scrape type 2
2026-01-28 17:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 521a6b23-285e-5e7d-95e6-f629618a3143, identifier: DX79549
2026-01-28 17:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 521a6b23-285e-5e7d-95e6-f629618a3143 with identifier: DX79549
2026-01-28 17:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-01-28 17:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-01-28 17:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 521a6b23-285e-5e7d-95e6-f629618a3143 with identifier: DX79549
2026-01-28 17:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 521a6b23-285e-5e7d-95e6-f629618a3143 with identifier: DX79549 to the API
2026-01-28 17:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DX79549>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:14:25Z',
 'fuel_type': 'petrol',
 'id': '521a6b23-285e-5e7d-95e6-f629618a3143',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX79549',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 41611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-01-28 17:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX79549%27 HTTP/1.1" 200 None
2026-01-28 17:00:22 [auto1.es] INFO: Saving data for DX79549: {'auction_closing_time': 1769703265.0, 'created_time': 1769421664.42523, 'last_price_update_time': 1769619622.031899}
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DX79549') HTTP/1.1" 204 0
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GW13583> (referer: https://www.auto1.com/v1/car-details-view/GW13583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF10969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX49357> (referer: https://www.auto1.com/v1/car-details-view/MX49357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY33885> (referer: https://www.auto1.com/v1/car-details-view/LY33885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL01160> (referer: https://www.auto1.com/v1/car-details-view/WL01160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX73472> (referer: https://www.auto1.com/v1/car-details-view/FX73472/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:22 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:22 [auto1.es] INFO: Found listing with ID: VX84940
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX84940%27 HTTP/1.1" 200 None
2026-01-28 17:00:22 [auto1.es] INFO: Scrape type for VX84940: 0
2026-01-28 17:00:22 [auto1.es] INFO: Found listing with ID: DP05914
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP05914%27 HTTP/1.1" 200 None
2026-01-28 17:00:22 [auto1.es] INFO: Scrape type for DP05914: 2
2026-01-28 17:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with identifier: GW13583
2026-01-28 17:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with scrape type 2
2026-01-28 17:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with scrape type 2
2026-01-28 17:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a456a9fa-f1ae-5fae-983c-899b5c7b3b54, identifier: GW13583
2026-01-28 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with identifier: GW13583
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-01-28 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-01-28 17:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with identifier: GW13583
2026-01-28 17:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a456a9fa-f1ae-5fae-983c-899b5c7b3b54 with identifier: GW13583 to the API
2026-01-28 17:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GW13583>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.3L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:46:15Z',
 'fuel_type': 'diesel',
 'id': 'a456a9fa-f1ae-5fae-983c-899b5c7b3b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW13583',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 25498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-60 3.3 e-Skyactiv D Exclusive-Line 2WD',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line 2WD',
 'year': 2024}
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW13583%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Saving data for GW13583: {'auction_closing_time': 1769705175.0, 'created_time': 1769102106.182195, 'last_price_update_time': 1769619623.169069}
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GW13583') HTTP/1.1" 204 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: YN74172
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN74172%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for YN74172: 2
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: AG11997
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG11997%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for AG11997: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: GX78930
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX78930%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for GX78930: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: BW69115
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW69115%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for BW69115: 2
2026-01-28 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7df3243-b236-53a9-9621-9464c43dbc2a with identifier: MX49357
2026-01-28 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7df3243-b236-53a9-9621-9464c43dbc2a with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7df3243-b236-53a9-9621-9464c43dbc2a with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7df3243-b236-53a9-9621-9464c43dbc2a, identifier: MX49357
2026-01-28 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 with identifier: LY33885
2026-01-28 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95, identifier: LY33885
2026-01-28 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86cd38a-55d2-57e8-9085-3107bec4864b with identifier: WL01160
2026-01-28 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86cd38a-55d2-57e8-9085-3107bec4864b with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b86cd38a-55d2-57e8-9085-3107bec4864b with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b86cd38a-55d2-57e8-9085-3107bec4864b, identifier: WL01160
2026-01-28 17:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53e97704-8b79-5247-9ea6-0aa8c30d77df with identifier: FX73472
2026-01-28 17:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53e97704-8b79-5247-9ea6-0aa8c30d77df with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53e97704-8b79-5247-9ea6-0aa8c30d77df with scrape type 2
2026-01-28 17:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53e97704-8b79-5247-9ea6-0aa8c30d77df, identifier: FX73472
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: TN28829
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN28829%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for TN28829: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: GB30495
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GB30495%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for GB30495: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: GM35418
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM35418%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for GM35418: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: SX70462
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SX70462%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for SX70462: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: US71601
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US71601%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for US71601: 0
2026-01-28 17:00:23 [auto1.es] INFO: Found listing with ID: ZG79943
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG79943%27 HTTP/1.1" 200 None
2026-01-28 17:00:23 [auto1.es] INFO: Scrape type for ZG79943: 2
2026-01-28 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7df3243-b236-53a9-9621-9464c43dbc2a with identifier: MX49357
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-01-28 17:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7df3243-b236-53a9-9621-9464c43dbc2a with identifier: MX49357
2026-01-28 17:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7df3243-b236-53a9-9621-9464c43dbc2a with identifier: MX49357 to the API
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MX49357>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:00:47Z',
 'fuel_type': 'petrol',
 'id': 'a7df3243-b236-53a9-9621-9464c43dbc2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX49357',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 85915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Trend+',
 'transmission': 'manual',
 'trim': 'Trend+',
 'year': 2018}
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MX49357%27 HTTP/1.1" 200 None
2026-01-28 17:00:24 [auto1.es] INFO: Saving data for MX49357: {'auction_closing_time': 1769702447.0, 'created_time': 1765818140.926138, 'last_price_update_time': 1769619624.403782}
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MX49357') HTTP/1.1" 204 0
2026-01-28 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 with identifier: LY33885
2026-01-28 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 with identifier: LY33885
2026-01-28 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192994 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192994
2026-01-28 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 spider: auto1.es
2026-01-28 17:00:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95 due to rule: high_mileage_for_country.json, error: 192994 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192994
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:37:43Z',
 'fuel_type': 'diesel',
 'id': '1b0f7def-5cc2-5ba3-ad7b-b2b00f2a8c95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY33885',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 192994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Tech",
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2019}
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY33885%27 HTTP/1.1" 200 None
2026-01-28 17:00:24 [auto1.es] INFO: Saving data for LY33885: {'auction_closing_time': 1769704663.0, 'created_time': 1768496695.894644, 'last_price_update_time': 1769619624.774621}
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LY33885') HTTP/1.1" 204 0
2026-01-28 17:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b86cd38a-55d2-57e8-9085-3107bec4864b with identifier: WL01160
2026-01-28 17:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b86cd38a-55d2-57e8-9085-3107bec4864b with identifier: WL01160
2026-01-28 17:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b86cd38a-55d2-57e8-9085-3107bec4864b with identifier: WL01160 to the API
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WL01160>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:42:23Z',
 'fuel_type': 'petrol',
 'id': 'b86cd38a-55d2-57e8-9085-3107bec4864b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL01160',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 69451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2019}
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WL01160%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Saving data for WL01160: {'auction_closing_time': 1769704943.0, 'created_time': 1768669271.57321, 'last_price_update_time': 1769619625.090319}
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WL01160') HTTP/1.1" 204 0
2026-01-28 17:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53e97704-8b79-5247-9ea6-0aa8c30d77df with identifier: FX73472
2026-01-28 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53e97704-8b79-5247-9ea6-0aa8c30d77df with identifier: FX73472
2026-01-28 17:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 53e97704-8b79-5247-9ea6-0aa8c30d77df with identifier: FX73472 to the API
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FX73472>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.0L',
 'engine_horse_power': 65,
 'expiration_date': '2026-01-29T16:03:59Z',
 'fuel_type': 'petrol',
 'id': '53e97704-8b79-5247-9ea6-0aa8c30d77df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX73472',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 48390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2021}
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX73472%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Saving data for FX73472: {'auction_closing_time': 1769702639.0, 'created_time': 1767114266.011581, 'last_price_update_time': 1769619625.410036}
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX73472') HTTP/1.1" 204 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: MG33728
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG33728%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for MG33728: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: FA30255
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA30255%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for FA30255: 2
2026-01-28 17:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ07748> (referer: https://www.auto1.com/v1/car-details-view/KJ07748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: LL32734
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL32734%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for LL32734: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: WX94287
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX94287%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for WX94287: 2
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: HW10674
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW10674%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for HW10674: 2
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: DP18472
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP18472%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for DP18472: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: UC47290
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC47290%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for UC47290: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: UT03911
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT03911%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for UT03911: 2
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: UG40177
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG40177%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for UG40177: 2
2026-01-28 17:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12428617-c07b-5612-b371-5c196ee930c7 with identifier: KJ07748
2026-01-28 17:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12428617-c07b-5612-b371-5c196ee930c7 with scrape type 2
2026-01-28 17:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12428617-c07b-5612-b371-5c196ee930c7 with scrape type 2
2026-01-28 17:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12428617-c07b-5612-b371-5c196ee930c7, identifier: KJ07748
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: VZ14488
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VZ14488%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for VZ14488: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: VK95324
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK95324%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for VK95324: 0
2026-01-28 17:00:25 [auto1.es] INFO: Found listing with ID: GP22189
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP22189%27 HTTP/1.1" 200 None
2026-01-28 17:00:25 [auto1.es] INFO: Scrape type for GP22189: 2
2026-01-28 17:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12428617-c07b-5612-b371-5c196ee930c7 with identifier: KJ07748
2026-01-28 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12428617-c07b-5612-b371-5c196ee930c7 with identifier: KJ07748
2026-01-28 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 17:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 12428617-c07b-5612-b371-5c196ee930c7 spider: auto1.es
2026-01-28 17:00:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 12428617-c07b-5612-b371-5c196ee930c7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 225,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:08:43Z',
 'fuel_type': 'diesel',
 'id': '12428617-c07b-5612-b371-5c196ee930c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ07748',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 75856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid L2 Trend',
 'transmission': 'manual',
 'trim': 'L2 Trend',
 'year': 2022}
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ07748%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Saving data for KJ07748: {'auction_closing_time': 1769702923.0, 'created_time': 1769421808.193193, 'last_price_update_time': 1769619626.012716}
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KJ07748') HTTP/1.1" 204 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: FY93718
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FY93718%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for FY93718: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: LW34581
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW34581%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for LW34581: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: FM29540
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM29540%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for FM29540: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: PL95593
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PL95593%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for PL95593: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: GY60731
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY60731%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for GY60731: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: ZK05634
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK05634%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for ZK05634: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: NW59290
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW59290%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for NW59290: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: UT89207
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89207%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for UT89207: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: KR57898
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR57898%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for KR57898: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: RD05990
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD05990%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for RD05990: 2
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: KP04085
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP04085%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for KP04085: 1
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: SF23553
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF23553%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for SF23553: 2
2026-01-28 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS15160> (referer: https://www.auto1.com/v1/car-details-view/ZS15160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: HU36118
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HU36118%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for HU36118: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: FR43336
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR43336%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for FR43336: 0
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: DZ72850
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ72850%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for DZ72850: 2
2026-01-28 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:26 [auto1.es] INFO: Found listing with ID: SF93230
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF93230%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Scrape type for SF93230: 0
2026-01-28 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH74673> (referer: https://www.auto1.com/v1/car-details-view/SH74673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH93641> (referer: https://www.auto1.com/v1/car-details-view/AH93641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG37952> (referer: https://www.auto1.com/v1/car-details-view/EG37952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with identifier: ZS15160
2026-01-28 17:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with scrape type 2
2026-01-28 17:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with scrape type 2
2026-01-28 17:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3, identifier: ZS15160
2026-01-28 17:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with identifier: ZS15160
2026-01-28 17:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with identifier: ZS15160
2026-01-28 17:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3 with identifier: ZS15160 to the API
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS15160>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:52:58Z',
 'fuel_type': 'petrol',
 'id': '8b7d7df8-d0bf-5ccc-b1e6-23c156b1c1d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS15160',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 78421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Drive",
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2019}
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS15160%27 HTTP/1.1" 200 None
2026-01-28 17:00:26 [auto1.es] INFO: Saving data for ZS15160: {'auction_closing_time': 1769705578.0, 'created_time': 1765818352.443912, 'last_price_update_time': 1769619626.971582}
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZS15160') HTTP/1.1" 204 0
2026-01-28 17:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE66422> (referer: https://www.auto1.com/v1/car-details-view/WE66422/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CZ20129> (referer: https://www.auto1.com/v1/car-details-view/CZ20129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC08667> (referer: https://www.auto1.com/v1/car-details-view/LC08667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-01-28 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a, identifier: SH74673
2026-01-28 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f415ac-4b27-5935-b494-c168a81d0cf5 with identifier: AH93641
2026-01-28 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f415ac-4b27-5935-b494-c168a81d0cf5 with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f415ac-4b27-5935-b494-c168a81d0cf5 with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 54f415ac-4b27-5935-b494-c168a81d0cf5, identifier: AH93641
2026-01-28 17:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f0e18b-dcec-599b-bf58-4547bac7866c with identifier: EG37952
2026-01-28 17:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f0e18b-dcec-599b-bf58-4547bac7866c with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f0e18b-dcec-599b-bf58-4547bac7866c with scrape type 2
2026-01-28 17:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b9f0e18b-dcec-599b-bf58-4547bac7866c, identifier: EG37952
2026-01-28 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a with identifier: SH74673
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.5 t-gdi amber 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 12107, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sh74673', 'expiration_date': '2026-01-29t16:04:16z', 'origin_country_code': 'es', 'trim': 'amber 4x2', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 163, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.5l', 'location': 'barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 161, 'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 12107}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 161,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'engine_horse_power': 163,
     'expiration_date': '2026-01-29t16:04:16z',
     'fuel_type': 'petrol',
     'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sh74673',
     'listing': 'auction',
     'location': 'barcelona',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 12107,
     'odometer_in_km': 12107,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-10',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.5 t-gdi amber 4x2',
     'transmission': 'manual',
     'trim': 'amber 4x2',
     'year': 2021}
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a spider: auto1.es
2026-01-28 17:00:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7d652d0e-e2f7-5f4a-b91b-7eed2d34012a due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.5 t-gdi amber 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 12107, 'odometer_reading_unit': 'km', 'registration_date': '2021-06-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sh74673', 'expiration_date': '2026-01-29t16:04:16z', 'origin_country_code': 'es', 'trim': 'amber 4x2', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 163, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.5l', 'location': 'barcelona', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 161, 'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a', 'current_year_diff': 5, 'age_in_months': 55, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 12107}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 55,
     'auction_title': '',
     'c_o_2_emission_value': 161,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'engine_horse_power': 163,
     'expiration_date': '2026-01-29t16:04:16z',
     'fuel_type': 'petrol',
     'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sh74673',
     'listing': 'auction',
     'location': 'barcelona',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 12107,
     'odometer_in_km': 12107,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-06-10',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.5 t-gdi amber 4x2',
     'transmission': 'manual',
     'trim': 'amber 4x2',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:04:16Z',
 'fuel_type': 'petrol',
 'id': '7d652d0e-e2f7-5f4a-b91b-7eed2d34012a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH74673',
 'listing': 'auction',
 'location': 'Barcelona',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 12107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.5 T-GDI Amber 4x2',
 'transmission': 'manual',
 'trim': 'Amber 4x2',
 'year': 2021}
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH74673%27 HTTP/1.1" 200 None
2026-01-28 17:00:27 [auto1.es] INFO: Saving data for SH74673: {'auction_closing_time': 1769702656.0, 'created_time': 1769518727.37766, 'last_price_update_time': 1769619627.666232}
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SH74673') HTTP/1.1" 204 0
2026-01-28 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 54f415ac-4b27-5935-b494-c168a81d0cf5 with identifier: AH93641
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 54f415ac-4b27-5935-b494-c168a81d0cf5 with identifier: AH93641
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180636 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180636
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 54f415ac-4b27-5935-b494-c168a81d0cf5 spider: auto1.es
2026-01-28 17:00:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 54f415ac-4b27-5935-b494-c168a81d0cf5 due to rule: high_mileage_for_country.json, error: 180636 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180636
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-01-29T16:53:33Z',
 'fuel_type': 'diesel',
 'id': '54f415ac-4b27-5935-b494-c168a81d0cf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH93641',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 180636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2020}
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH93641%27 HTTP/1.1" 200 None
2026-01-28 17:00:27 [auto1.es] INFO: Saving data for AH93641: {'auction_closing_time': 1769705613.0, 'created_time': 1768912683.977727, 'last_price_update_time': 1769619627.885558}
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH93641') HTTP/1.1" 204 0
2026-01-28 17:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b9f0e18b-dcec-599b-bf58-4547bac7866c with identifier: EG37952
2026-01-28 17:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b9f0e18b-dcec-599b-bf58-4547bac7866c with identifier: EG37952
2026-01-28 17:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b9f0e18b-dcec-599b-bf58-4547bac7866c with identifier: EG37952 to the API
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EG37952>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:29:47Z',
 'fuel_type': 'petrol',
 'id': 'b9f0e18b-dcec-599b-bf58-4547bac7866c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG37952',
 'listing': 'auction',
 'location': 'ES, Rubí',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 100354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG37952%27 HTTP/1.1" 200 None
2026-01-28 17:00:28 [auto1.es] INFO: Saving data for EG37952: {'auction_closing_time': 1769704187.0, 'created_time': 1769518782.584441, 'last_price_update_time': 1769619628.235352}
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG37952') HTTP/1.1" 204 0
2026-01-28 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e4c8b3b-1245-5041-81d7-5549a44948e4 with identifier: WE66422
2026-01-28 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e4c8b3b-1245-5041-81d7-5549a44948e4 with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e4c8b3b-1245-5041-81d7-5549a44948e4 with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e4c8b3b-1245-5041-81d7-5549a44948e4, identifier: WE66422
2026-01-28 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2026-01-28 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096e1f81-862c-5625-840d-a39ef2177b43 with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 096e1f81-862c-5625-840d-a39ef2177b43 with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 096e1f81-862c-5625-840d-a39ef2177b43, identifier: CZ20129
2026-01-28 17:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with identifier: LC08667
2026-01-28 17:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with scrape type 2
2026-01-28 17:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ecab718b-9cac-5d39-b917-8c0f5ea1bd0e, identifier: LC08667
2026-01-28 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e4c8b3b-1245-5041-81d7-5549a44948e4 with identifier: WE66422
2026-01-28 17:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e4c8b3b-1245-5041-81d7-5549a44948e4 with identifier: WE66422
2026-01-28 17:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e4c8b3b-1245-5041-81d7-5549a44948e4 with identifier: WE66422 to the API
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WE66422>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:42:17Z',
 'fuel_type': 'diesel',
 'id': '6e4c8b3b-1245-5041-81d7-5549a44948e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE66422',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 94126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-16',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE66422%27 HTTP/1.1" 200 None
2026-01-28 17:00:28 [auto1.es] INFO: Saving data for WE66422: {'auction_closing_time': 1769704937.0, 'created_time': 1768653356.118348, 'last_price_update_time': 1769619628.859769}
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WE66422') HTTP/1.1" 204 0
2026-01-28 17:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-01-28 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 096e1f81-862c-5625-840d-a39ef2177b43 with identifier: CZ20129
2026-01-28 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160916 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160916
2026-01-28 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 096e1f81-862c-5625-840d-a39ef2177b43 spider: auto1.es
2026-01-28 17:00:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 096e1f81-862c-5625-840d-a39ef2177b43 due to rule: high_mileage_for_country.json, error: 160916 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160916
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:01:22Z',
 'fuel_type': 'petrol',
 'id': '096e1f81-862c-5625-840d-a39ef2177b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ20129',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 160916,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR Go 2',
 'transmission': 'manual',
 'trim': 'FR Go 2',
 'year': 2021}
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ20129%27 HTTP/1.1" 200 None
2026-01-28 17:00:29 [auto1.es] INFO: Saving data for CZ20129: {'auction_closing_time': 1769702482.0, 'created_time': 1764762787.120681, 'last_price_update_time': 1769619629.297765}
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CZ20129') HTTP/1.1" 204 0
2026-01-28 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with identifier: LC08667
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-01-28 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with identifier: LC08667
2026-01-28 17:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ecab718b-9cac-5d39-b917-8c0f5ea1bd0e with identifier: LC08667 to the API
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LC08667>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:31:28Z',
 'fuel_type': 'petrol',
 'id': 'ecab718b-9cac-5d39-b917-8c0f5ea1bd0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC08667',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 107833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC08667%27 HTTP/1.1" 200 None
2026-01-28 17:00:29 [auto1.es] INFO: Saving data for LC08667: {'auction_closing_time': 1769704288.0, 'created_time': 1769002739.692286, 'last_price_update_time': 1769619629.755019}
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC08667') HTTP/1.1" 204 0
2026-01-28 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF54775> (referer: https://www.auto1.com/v1/car-details-view/FF54775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF32927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC43359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with identifier: FF54775
2026-01-28 17:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with scrape type 2
2026-01-28 17:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with scrape type 2
2026-01-28 17:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cacb74d-14b3-51a2-97d6-61d33eabcc22, identifier: FF54775
2026-01-28 17:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with identifier: FF54775
2026-01-28 17:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with identifier: FF54775
2026-01-28 17:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5cacb74d-14b3-51a2-97d6-61d33eabcc22 with identifier: FF54775 to the API
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF54775>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:50:24Z',
 'fuel_type': 'petrol',
 'id': '5cacb74d-14b3-51a2-97d6-61d33eabcc22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF54775',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 66709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF54775%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Saving data for FF54775: {'auction_closing_time': 1769705424.0, 'created_time': 1767619156.816581, 'last_price_update_time': 1769619630.345191}
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FF54775') HTTP/1.1" 204 0
2026-01-28 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP05914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:30 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: KV73923
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV73923%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for KV73923: 1
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: ZR54852
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR54852%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for ZR54852: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: GC05053
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC05053%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for GC05053: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: VJ96462
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ96462%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for VJ96462: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: PV27185
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV27185%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for PV27185: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: YB91679
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB91679%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for YB91679: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: BY34370
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY34370%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for BY34370: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: WH50900
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH50900%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for WH50900: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: PF19696
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF19696%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for PF19696: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: BE57160
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE57160%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for BE57160: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: AC14162
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC14162%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for AC14162: 2
2026-01-28 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA44926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: VF64596
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF64596%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for VF64596: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: UG66200
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG66200%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for UG66200: 2
2026-01-28 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: ZC94870
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC94870%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for ZC94870: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: BG39460
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG39460%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for BG39460: 2
2026-01-28 17:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP05677/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: HG19376
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG19376%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for HG19376: 2
2026-01-28 17:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: GV47031
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV47031%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for GV47031: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: EY33498
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY33498%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for EY33498: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: YW42428
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW42428%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for YW42428: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: MK11093
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK11093%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for MK11093: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: RV86975
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV86975%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for RV86975: 0
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: VY09840
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY09840%27 HTTP/1.1" 200 None
2026-01-28 17:00:30 [auto1.es] INFO: Scrape type for VY09840: 2
2026-01-28 17:00:30 [auto1.es] INFO: Found listing with ID: XR21802
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR21802%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for XR21802: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: ZH60246
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH60246%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for ZH60246: 2
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: DX14493
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX14493%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for DX14493: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: SJ24506
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SJ24506%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for SJ24506: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: JS57551
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS57551%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for JS57551: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: CN68851
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN68851%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for CN68851: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: JC52859
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC52859%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for JC52859: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: WS46179
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS46179%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for WS46179: 2
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: ZS76119
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS76119%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for ZS76119: 1
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: NZ61100
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ61100%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for NZ61100: 2
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: KK88353
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK88353%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for KK88353: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: AN83827
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN83827%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for AN83827: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: PD49428
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD49428%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for PD49428: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: PZ01712
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ01712%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for PZ01712: 2
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: DV94358
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV94358%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for DV94358: 2
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ72850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: DW14150
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW14150%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for DW14150: 2
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM34191> (referer: https://www.auto1.com/v1/car-details-view/TM34191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: GJ77570
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ77570%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for GJ77570: 0
2026-01-28 17:00:31 [auto1.es] INFO: Found listing with ID: MN19248
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN19248%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Scrape type for MN19248: 2
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf with identifier: TM34191
2026-01-28 17:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf with scrape type 2
2026-01-28 17:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf with scrape type 2
2026-01-28 17:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf, identifier: TM34191
2026-01-28 17:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf with identifier: TM34191
2026-01-28 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf with identifier: TM34191
2026-01-28 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 caravelle' containing 'caravelle'
2026-01-28 17:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf spider: auto1.es
2026-01-28 17:00:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5a67c1ca-2b1b-57f2-8052-5c3573e2afcf due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 caravelle' containing 'caravelle'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '5a67c1ca-2b1b-57f2-8052-5c3573e2afcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM34191',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Volkswagen',
 'model': 'T6 Caravelle',
 'odometer': 75291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Caravelle 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2018}
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TM34191%27 HTTP/1.1" 200 None
2026-01-28 17:00:31 [auto1.es] INFO: Saving data for TM34191: {'auction_closing_time': 1769702934.0, 'created_time': 1769519794.369954, 'last_price_update_time': 1769619631.732989}
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TM34191') HTTP/1.1" 204 0
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF23553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD05990/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA30255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR57898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT89207/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK05634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW59290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP22189/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM29540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC43359> (referer: https://www.auto1.com/v1/car-details-view/YC43359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF32927> (referer: https://www.auto1.com/v1/car-details-view/GF32927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 107e2415-534c-5adf-b4eb-6225042c5e16 with identifier: YC43359
2026-01-28 17:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 107e2415-534c-5adf-b4eb-6225042c5e16 with scrape type 2
2026-01-28 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 107e2415-534c-5adf-b4eb-6225042c5e16 with scrape type 2
2026-01-28 17:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 107e2415-534c-5adf-b4eb-6225042c5e16, identifier: YC43359
2026-01-28 17:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 107e2415-534c-5adf-b4eb-6225042c5e16 with identifier: YC43359
2026-01-28 17:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 107e2415-534c-5adf-b4eb-6225042c5e16 with identifier: YC43359
2026-01-28 17:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 107e2415-534c-5adf-b4eb-6225042c5e16 with identifier: YC43359 to the API
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC43359>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:49:15Z',
 'fuel_type': 'petrol',
 'id': '107e2415-534c-5adf-b4eb-6225042c5e16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC43359',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 33521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC43359%27 HTTP/1.1" 200 None
2026-01-28 17:00:33 [auto1.es] INFO: Saving data for YC43359: {'auction_closing_time': 1769705355.0, 'created_time': 1769518635.452455, 'last_price_update_time': 1769619633.432087}
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC43359') HTTP/1.1" 204 0
2026-01-28 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV94358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG39460/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 674723b7-d723-5778-87c4-87f7b9f5a0bd with identifier: GF32927
2026-01-28 17:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 674723b7-d723-5778-87c4-87f7b9f5a0bd with scrape type 2
2026-01-28 17:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 674723b7-d723-5778-87c4-87f7b9f5a0bd with scrape type 2
2026-01-28 17:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 674723b7-d723-5778-87c4-87f7b9f5a0bd, identifier: GF32927
2026-01-28 17:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 674723b7-d723-5778-87c4-87f7b9f5a0bd with identifier: GF32927
2026-01-28 17:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 674723b7-d723-5778-87c4-87f7b9f5a0bd with identifier: GF32927
2026-01-28 17:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 674723b7-d723-5778-87c4-87f7b9f5a0bd with identifier: GF32927 to the API
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GF32927>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:20:13Z',
 'fuel_type': 'petrol',
 'id': '674723b7-d723-5778-87c4-87f7b9f5a0bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF32927',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 119264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF32927%27 HTTP/1.1" 200 None
2026-01-28 17:00:33 [auto1.es] INFO: Saving data for GF32927: {'auction_closing_time': 1769703613.0, 'created_time': 1769101736.755147, 'last_price_update_time': 1769619633.830629}
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GF32927') HTTP/1.1" 204 0
2026-01-28 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW14150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP04085/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN19248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZS76119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ01712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ61100/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ72850> (referer: https://www.auto1.com/v1/car-details-view/DZ72850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC14162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ef7805-fecc-588d-b967-a54fc7a04ae2 with identifier: DZ72850
2026-01-28 17:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ef7805-fecc-588d-b967-a54fc7a04ae2 with scrape type 2
2026-01-28 17:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ef7805-fecc-588d-b967-a54fc7a04ae2 with scrape type 2
2026-01-28 17:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1ef7805-fecc-588d-b967-a54fc7a04ae2, identifier: DZ72850
2026-01-28 17:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1ef7805-fecc-588d-b967-a54fc7a04ae2 with identifier: DZ72850
2026-01-28 17:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1ef7805-fecc-588d-b967-a54fc7a04ae2 with identifier: DZ72850
2026-01-28 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142919 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142919
2026-01-28 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a1ef7805-fecc-588d-b967-a54fc7a04ae2 spider: auto1.es
2026-01-28 17:00:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a1ef7805-fecc-588d-b967-a54fc7a04ae2 due to rule: high_mileage_for_make.json, error: 142919 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142919
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:56:56Z',
 'fuel_type': 'diesel',
 'id': 'a1ef7805-fecc-588d-b967-a54fc7a04ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ72850',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 142919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Lusso 2WD',
 'transmission': 'automatic',
 'trim': 'Lusso 2WD',
 'year': 2020}
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DZ72850%27 HTTP/1.1" 200 None
2026-01-28 17:00:35 [auto1.es] INFO: Saving data for DZ72850: {'auction_closing_time': 1769705816.0, 'created_time': 1769014949.066213, 'last_price_update_time': 1769619635.167111}
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DZ72850') HTTP/1.1" 204 0
2026-01-28 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR57898> (referer: https://www.auto1.com/v1/car-details-view/KR57898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 558c416d-fa31-5e56-a7a6-a622f59f280f with identifier: KR57898
2026-01-28 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 558c416d-fa31-5e56-a7a6-a622f59f280f with scrape type 2
2026-01-28 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 558c416d-fa31-5e56-a7a6-a622f59f280f with scrape type 2
2026-01-28 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 558c416d-fa31-5e56-a7a6-a622f59f280f, identifier: KR57898
2026-01-28 17:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 558c416d-fa31-5e56-a7a6-a622f59f280f with identifier: KR57898
2026-01-28 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 558c416d-fa31-5e56-a7a6-a622f59f280f with identifier: KR57898
2026-01-28 17:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 558c416d-fa31-5e56-a7a6-a622f59f280f with identifier: KR57898 to the API
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR57898>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:50:19Z',
 'fuel_type': 'petrol',
 'id': '558c416d-fa31-5e56-a7a6-a622f59f280f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR57898',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 9387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2024}
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR57898%27 HTTP/1.1" 200 None
2026-01-28 17:00:35 [auto1.es] INFO: Saving data for KR57898: {'auction_closing_time': 1769705419.0, 'created_time': 1769003061.698667, 'last_price_update_time': 1769619635.723696}
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KR57898') HTTP/1.1" 204 0
2026-01-28 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW59290> (referer: https://www.auto1.com/v1/car-details-view/NW59290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP22189> (referer: https://www.auto1.com/v1/car-details-view/GP22189/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK05634> (referer: https://www.auto1.com/v1/car-details-view/ZK05634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf976371-8621-522e-9b8e-003a382ba6c6 with identifier: NW59290
2026-01-28 17:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf976371-8621-522e-9b8e-003a382ba6c6 with scrape type 2
2026-01-28 17:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf976371-8621-522e-9b8e-003a382ba6c6 with scrape type 2
2026-01-28 17:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf976371-8621-522e-9b8e-003a382ba6c6, identifier: NW59290
2026-01-28 17:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf976371-8621-522e-9b8e-003a382ba6c6 with identifier: NW59290
2026-01-28 17:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf976371-8621-522e-9b8e-003a382ba6c6 with identifier: NW59290
2026-01-28 17:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf976371-8621-522e-9b8e-003a382ba6c6 with identifier: NW59290 to the API
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NW59290>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:40:35Z',
 'fuel_type': 'petrol',
 'id': 'cf976371-8621-522e-9b8e-003a382ba6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW59290',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 55692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW59290%27 HTTP/1.1" 200 None
2026-01-28 17:00:36 [auto1.es] INFO: Saving data for NW59290: {'auction_closing_time': 1769704835.0, 'created_time': 1768928673.156822, 'last_price_update_time': 1769619636.258188}
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW59290') HTTP/1.1" 204 0
2026-01-28 17:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9390cc2d-b24d-5324-823d-7fc3cbe072cc with identifier: GP22189
2026-01-28 17:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9390cc2d-b24d-5324-823d-7fc3cbe072cc with scrape type 2
2026-01-28 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9390cc2d-b24d-5324-823d-7fc3cbe072cc with scrape type 2
2026-01-28 17:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9390cc2d-b24d-5324-823d-7fc3cbe072cc, identifier: GP22189
2026-01-28 17:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5387bab9-970f-5d34-8686-b55719e90a18 with identifier: ZK05634
2026-01-28 17:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5387bab9-970f-5d34-8686-b55719e90a18 with scrape type 2
2026-01-28 17:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5387bab9-970f-5d34-8686-b55719e90a18 with scrape type 2
2026-01-28 17:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5387bab9-970f-5d34-8686-b55719e90a18, identifier: ZK05634
2026-01-28 17:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA30255> (referer: https://www.auto1.com/v1/car-details-view/FA30255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9390cc2d-b24d-5324-823d-7fc3cbe072cc with identifier: GP22189
2026-01-28 17:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9390cc2d-b24d-5324-823d-7fc3cbe072cc with identifier: GP22189
2026-01-28 17:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9390cc2d-b24d-5324-823d-7fc3cbe072cc with identifier: GP22189 to the API
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%279390cc2d-b24d-5324-823d-7fc3cbe072cc%27 HTTP/1.1" 200 None
2026-01-28 17:00:36 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 9390cc2d-b24d-5324-823d-7fc3cbe072cc: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP22189>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:48:07Z',
 'fuel_type': 'petrol',
 'id': '9390cc2d-b24d-5324-823d-7fc3cbe072cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP22189',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 24312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2024}
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP22189%27 HTTP/1.1" 200 None
2026-01-28 17:00:36 [auto1.es] INFO: Saving data for GP22189: {'auction_closing_time': 1769705287.0, 'created_time': 1766037692.083576, 'last_price_update_time': 1769619636.781123}
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GP22189') HTTP/1.1" 204 0
2026-01-28 17:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5387bab9-970f-5d34-8686-b55719e90a18 with identifier: ZK05634
2026-01-28 17:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5387bab9-970f-5d34-8686-b55719e90a18 with identifier: ZK05634
2026-01-28 17:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5387bab9-970f-5d34-8686-b55719e90a18 with identifier: ZK05634 to the API
2026-01-28 17:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK05634>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:05:13Z',
 'fuel_type': 'petrol',
 'id': '5387bab9-970f-5d34-8686-b55719e90a18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK05634',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 138364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2019}
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK05634%27 HTTP/1.1" 200 None
2026-01-28 17:00:37 [auto1.es] INFO: Saving data for ZK05634: {'auction_closing_time': 1769702713.0, 'created_time': 1769003295.059481, 'last_price_update_time': 1769619637.181324}
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK05634') HTTP/1.1" 204 0
2026-01-28 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF23553> (referer: https://www.auto1.com/v1/car-details-view/SF23553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD05990> (referer: https://www.auto1.com/v1/car-details-view/RD05990/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM29540> (referer: https://www.auto1.com/v1/car-details-view/FM29540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT89207> (referer: https://www.auto1.com/v1/car-details-view/UT89207/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40bfea60-ba2a-5759-b6c0-57dea1baac78 with identifier: FA30255
2026-01-28 17:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40bfea60-ba2a-5759-b6c0-57dea1baac78 with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40bfea60-ba2a-5759-b6c0-57dea1baac78 with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40bfea60-ba2a-5759-b6c0-57dea1baac78, identifier: FA30255
2026-01-28 17:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40bfea60-ba2a-5759-b6c0-57dea1baac78 with identifier: FA30255
2026-01-28 17:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40bfea60-ba2a-5759-b6c0-57dea1baac78 with identifier: FA30255
2026-01-28 17:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40bfea60-ba2a-5759-b6c0-57dea1baac78 with identifier: FA30255 to the API
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FA30255>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 84,
 'expiration_date': '2026-01-29T16:55:02Z',
 'fuel_type': 'petrol',
 'id': '40bfea60-ba2a-5759-b6c0-57dea1baac78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA30255',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 22394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2022}
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FA30255%27 HTTP/1.1" 200 None
2026-01-28 17:00:37 [auto1.es] INFO: Saving data for FA30255: {'auction_closing_time': 1769705702.0, 'created_time': 1769421725.682089, 'last_price_update_time': 1769619637.627446}
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FA30255') HTTP/1.1" 204 0
2026-01-28 17:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6613f012-9644-5b90-ae09-5bfcf221225a with identifier: SF23553
2026-01-28 17:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6613f012-9644-5b90-ae09-5bfcf221225a with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6613f012-9644-5b90-ae09-5bfcf221225a with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6613f012-9644-5b90-ae09-5bfcf221225a, identifier: SF23553
2026-01-28 17:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc814dc2-3519-5a14-b93a-a2c8bb25e866 with identifier: RD05990
2026-01-28 17:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc814dc2-3519-5a14-b93a-a2c8bb25e866 with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc814dc2-3519-5a14-b93a-a2c8bb25e866 with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc814dc2-3519-5a14-b93a-a2c8bb25e866, identifier: RD05990
2026-01-28 17:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29bca7c5-29f6-5e01-bf60-49e59aa77110 with identifier: FM29540
2026-01-28 17:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29bca7c5-29f6-5e01-bf60-49e59aa77110 with scrape type 2
2026-01-28 17:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29bca7c5-29f6-5e01-bf60-49e59aa77110 with scrape type 2
2026-01-28 17:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29bca7c5-29f6-5e01-bf60-49e59aa77110, identifier: FM29540
2026-01-28 17:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 with identifier: UT89207
2026-01-28 17:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 with scrape type 2
2026-01-28 17:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 with scrape type 2
2026-01-28 17:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2, identifier: UT89207
2026-01-28 17:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6613f012-9644-5b90-ae09-5bfcf221225a with identifier: SF23553
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6613f012-9644-5b90-ae09-5bfcf221225a with identifier: SF23553
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech tech edition', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 98924, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sf23553', 'expiration_date': '2026-01-29t16:40:59z', 'origin_country_code': 'es', 'trim': 'tech edition', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '6613f012-9644-5b90-ae09-5bfcf221225a', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 98924}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:40:59z',
     'fuel_type': 'petrol',
     'id': '6613f012-9644-5b90-ae09-5bfcf221225a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sf23553',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 98924,
     'odometer_in_km': 98924,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech tech edition',
     'transmission': 'manual',
     'trim': 'tech edition',
     'year': 2018}
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6613f012-9644-5b90-ae09-5bfcf221225a spider: auto1.es
2026-01-28 17:00:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6613f012-9644-5b90-ae09-5bfcf221225a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech tech edition', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'manual', 'odometer': 98924, 'odometer_reading_unit': 'km', 'registration_date': '2018-11-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sf23553', 'expiration_date': '2026-01-29t16:40:59z', 'origin_country_code': 'es', 'trim': 'tech edition', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 120, 'id': '6613f012-9644-5b90-ae09-5bfcf221225a', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 98924}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:40:59z',
     'fuel_type': 'petrol',
     'id': '6613f012-9644-5b90-ae09-5bfcf221225a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sf23553',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 98924,
     'odometer_in_km': 98924,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-11-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech tech edition',
     'transmission': 'manual',
     'trim': 'tech edition',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:40:59Z',
 'fuel_type': 'petrol',
 'id': '6613f012-9644-5b90-ae09-5bfcf221225a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF23553',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 98924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech Tech Edition',
 'transmission': 'manual',
 'trim': 'Tech Edition',
 'year': 2018}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF23553%27 HTTP/1.1" 200 None
2026-01-28 17:00:38 [auto1.es] INFO: Saving data for SF23553: {'auction_closing_time': 1769704859.0, 'created_time': 1769101304.991039, 'last_price_update_time': 1769619638.350005}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SF23553') HTTP/1.1" 204 0
2026-01-28 17:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc814dc2-3519-5a14-b93a-a2c8bb25e866 with identifier: RD05990
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc814dc2-3519-5a14-b93a-a2c8bb25e866 with identifier: RD05990
2026-01-28 17:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc814dc2-3519-5a14-b93a-a2c8bb25e866 with identifier: RD05990 to the API
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD05990>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:42:19Z',
 'fuel_type': 'diesel',
 'id': 'dc814dc2-3519-5a14-b93a-a2c8bb25e866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD05990',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 70848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2022}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD05990%27 HTTP/1.1" 200 None
2026-01-28 17:00:38 [auto1.es] INFO: Saving data for RD05990: {'auction_closing_time': 1769704939.0, 'created_time': 1767872470.596711, 'last_price_update_time': 1769619638.745953}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD05990') HTTP/1.1" 204 0
2026-01-28 17:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29bca7c5-29f6-5e01-bf60-49e59aa77110 with identifier: FM29540
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29bca7c5-29f6-5e01-bf60-49e59aa77110 with identifier: FM29540
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 188561 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188561
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29bca7c5-29f6-5e01-bf60-49e59aa77110 spider: auto1.es
2026-01-28 17:00:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 29bca7c5-29f6-5e01-bf60-49e59aa77110 due to rule: high_mileage_for_country.json, error: 188561 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    188561
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:48:49Z',
 'fuel_type': 'diesel',
 'id': '29bca7c5-29f6-5e01-bf60-49e59aa77110',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM29540',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 188561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2018}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM29540%27 HTTP/1.1" 200 None
2026-01-28 17:00:38 [auto1.es] INFO: Saving data for FM29540: {'auction_closing_time': 1769705329.0, 'created_time': 1769162644.488697, 'last_price_update_time': 1769619638.960023}
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FM29540') HTTP/1.1" 204 0
2026-01-28 17:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 with identifier: UT89207
2026-01-28 17:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 with identifier: UT89207
2026-01-28 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
2026-01-28 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 spider: auto1.es
2026-01-28 17:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 multivan' containing 'multivan'
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:53Z',
 'fuel_type': 'diesel',
 'id': '78eec7c9-52eb-5cae-9ca6-eb0e977fd2b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT89207',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 61560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
 'transmission': 'automatic',
 'trim': 'Trendline FWD',
 'year': 2021}
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT89207%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [auto1.es] INFO: Saving data for UT89207: {'auction_closing_time': 1769703353.0, 'created_time': 1768823877.000476, 'last_price_update_time': 1769619639.187524}
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT89207') HTTP/1.1" 204 0
2026-01-28 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS46179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP04085> (referer: https://www.auto1.com/v1/car-details-view/KP04085/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW14150> (referer: https://www.auto1.com/v1/car-details-view/DW14150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f921c0d-0536-5707-9410-42229c5ce8d0 with identifier: KP04085
2026-01-28 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f921c0d-0536-5707-9410-42229c5ce8d0 with scrape type 1
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg not downloaded yet
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_df001decd3844e8e99544c0ab415e526.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_df001decd3844e8e99544c0ab415e526.jpg not downloaded yet
2026-01-28 17:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6b24f0-d525-5e69-98d8-13401fff9ef2 with identifier: DW14150
2026-01-28 17:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6b24f0-d525-5e69-98d8-13401fff9ef2 with scrape type 2
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6b24f0-d525-5e69-98d8-13401fff9ef2 with scrape type 2
2026-01-28 17:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc6b24f0-d525-5e69-98d8-13401fff9ef2, identifier: DW14150
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg not downloaded yet
2026-01-28 17:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc6b24f0-d525-5e69-98d8-13401fff9ef2 with identifier: DW14150
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-01-28 17:00:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc6b24f0-d525-5e69-98d8-13401fff9ef2 with identifier: DW14150
2026-01-28 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 42755, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dw14150', 'expiration_date': '2026-01-29t16:51:45z', 'origin_country_code': 'es', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el puerto de santa maria', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': 'dc6b24f0-d525-5e69-98d8-13401fff9ef2', 'current_year_diff': 4, 'age_in_months': 42, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 42755}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 42,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:51:45z',
     'fuel_type': 'petrol',
     'id': 'dc6b24f0-d525-5e69-98d8-13401fff9ef2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dw14150',
     'listing': 'auction',
     'location': 'es, el puerto de santa maria',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 42755,
     'odometer_in_km': 42755,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-13',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
2026-01-28 17:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: dc6b24f0-d525-5e69-98d8-13401fff9ef2 spider: auto1.es
2026-01-28 17:00:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dc6b24f0-d525-5e69-98d8-13401fff9ef2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 42755, 'odometer_reading_unit': 'km', 'registration_date': '2022-07-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dw14150', 'expiration_date': '2026-01-29t16:51:45z', 'origin_country_code': 'es', 'trim': 'active pack', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el puerto de santa maria', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': 'dc6b24f0-d525-5e69-98d8-13401fff9ef2', 'current_year_diff': 4, 'age_in_months': 42, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 42755}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 42,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:51:45z',
     'fuel_type': 'petrol',
     'id': 'dc6b24f0-d525-5e69-98d8-13401fff9ef2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dw14150',
     'listing': 'auction',
     'location': 'es, el puerto de santa maria',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 42755,
     'odometer_in_km': 42755,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-07-13',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active pack',
     'transmission': 'manual',
     'trim': 'active pack',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:51:45Z',
 'fuel_type': 'petrol',
 'id': 'dc6b24f0-d525-5e69-98d8-13401fff9ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW14150',
 'listing': 'auction',
 'location': 'ES, EL PUERTO DE SANTA MARIA',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 42755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DW14150%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [auto1.es] INFO: Saving data for DW14150: {'auction_closing_time': 1769705505.0, 'created_time': 1768824403.163898, 'last_price_update_time': 1769619639.930229}
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DW14150') HTTP/1.1" 204 0
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_f3eea64b944e43015a72e4316b112f8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_f3eea64b944e43015a72e4316b112f8d.jpg not downloaded yet
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_3b7bdda19cf176e6d9a702507821ce10.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_3b7bdda19cf176e6d9a702507821ce10.jpg not downloaded yet
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_a037ea93e7add0ae219c724528344875.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_a037ea93e7add0ae219c724528344875.jpg not downloaded yet
2026-01-28 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ01712> (referer: https://www.auto1.com/v1/car-details-view/PZ01712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg not downloaded yet
2026-01-28 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZS76119> (referer: https://www.auto1.com/v1/car-details-view/ZS76119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG39460> (referer: https://www.auto1.com/v1/car-details-view/BG39460/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_38ed9f59827db07f3eefa04a80403ce5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_38ed9f59827db07f3eefa04a80403ce5.jpg not downloaded yet
2026-01-28 17:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg not downloaded yet
2026-01-28 17:00:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN19248> (referer: https://www.auto1.com/v1/car-details-view/MN19248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_00c2fc1d107460bec23b95c1b05e3133.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_00c2fc1d107460bec23b95c1b05e3133.jpg not downloaded yet
2026-01-28 17:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627ee183-5d4b-51c8-a686-a2d82b79b694 with identifier: PZ01712
2026-01-28 17:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627ee183-5d4b-51c8-a686-a2d82b79b694 with scrape type 2
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627ee183-5d4b-51c8-a686-a2d82b79b694 with scrape type 2
2026-01-28 17:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 627ee183-5d4b-51c8-a686-a2d82b79b694, identifier: PZ01712
2026-01-28 17:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2 with identifier: ZS76119
2026-01-28 17:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2 with scrape type 1
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_6013246d54092252586536f7ba16c2e9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_6013246d54092252586536f7ba16c2e9.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_19a64626b105dd18e37a174f3caf071b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_19a64626b105dd18e37a174f3caf071b.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_e5c82e3988866eab73605204ba3af171.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e5c82e3988866eab73605204ba3af171.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_b5b3b4069a90e033475dfa61fa1b74b9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5b3b4069a90e033475dfa61fa1b74b9.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_b5f1f71fe391628ce283f3a8cdde64b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5f1f71fe391628ce283f3a8cdde64b6.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_b668dc6d579a3afa4a245bf06738132b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b668dc6d579a3afa4a245bf06738132b.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_1a444a4477f034add37d879ad66e1bba.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_1a444a4477f034add37d879ad66e1bba.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_d1f694e2ce1b0a358c3ad9f0dfbae145.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_d1f694e2ce1b0a358c3ad9f0dfbae145.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_69fcff1bd7b14b5ede28eabc283756b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_69fcff1bd7b14b5ede28eabc283756b0.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_e4e86378f0bb353b381c7afcc4411f25.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e4e86378f0bb353b381c7afcc4411f25.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_8c2fe88fd5f7607173aaf254a865d068.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_8c2fe88fd5f7607173aaf254a865d068.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_735ca8e7eda38b08142b91e66ed7a907.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_735ca8e7eda38b08142b91e66ed7a907.jpg already downloaded
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252Fe8%252F9ee8fad7dd5d4c113e6d7199f6ee3f17%252Fpa%252FZS76119_137c964cc1702c5ef122f9000622eb60.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_137c964cc1702c5ef122f9000622eb60.jpg already downloaded
2026-01-28 17:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2, identifier: ZS76119
2026-01-28 17:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f56d113-75d4-5f0e-8fa8-ae567d882343 with identifier: BG39460
2026-01-28 17:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f56d113-75d4-5f0e-8fa8-ae567d882343 with scrape type 2
2026-01-28 17:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f56d113-75d4-5f0e-8fa8-ae567d882343 with scrape type 2
2026-01-28 17:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8f56d113-75d4-5f0e-8fa8-ae567d882343, identifier: BG39460
2026-01-28 17:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 627ee183-5d4b-51c8-a686-a2d82b79b694 with identifier: PZ01712
2026-01-28 17:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 627ee183-5d4b-51c8-a686-a2d82b79b694 with identifier: PZ01712
2026-01-28 17:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 627ee183-5d4b-51c8-a686-a2d82b79b694 with identifier: PZ01712 to the API
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ01712>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:24:40Z',
 'fuel_type': 'diesel',
 'id': '627ee183-5d4b-51c8-a686-a2d82b79b694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ01712',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 105131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ01712%27 HTTP/1.1" 200 None
2026-01-28 17:00:41 [auto1.es] INFO: Saving data for PZ01712: {'auction_closing_time': 1769703880.0, 'created_time': 1768912849.237062, 'last_price_update_time': 1769619641.093991}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ01712') HTTP/1.1" 204 0
2026-01-28 17:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2 with identifier: ZS76119
2026-01-28 17:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2 with identifier: ZS76119
2026-01-28 17:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 913f8e91-7035-5d56-8beb-2bb1c9a2cfc2 with identifier: ZS76119 to the API
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZS76119>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:56:35Z',
 'fuel_type': 'petrol',
 'id': '913f8e91-7035-5d56-8beb-2bb1c9a2cfc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS76119',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 140089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_6013246d54092252586536f7ba16c2e9.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_19a64626b105dd18e37a174f3caf071b.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e5c82e3988866eab73605204ba3af171.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5b3b4069a90e033475dfa61fa1b74b9.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5f1f71fe391628ce283f3a8cdde64b6.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b668dc6d579a3afa4a245bf06738132b.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_1a444a4477f034add37d879ad66e1bba.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_d1f694e2ce1b0a358c3ad9f0dfbae145.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_69fcff1bd7b14b5ede28eabc283756b0.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e4e86378f0bb353b381c7afcc4411f25.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_8c2fe88fd5f7607173aaf254a865d068.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_735ca8e7eda38b08142b91e66ed7a907.jpg',
                'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_137c964cc1702c5ef122f9000622eb60.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_6013246d54092252586536f7ba16c2e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_19a64626b105dd18e37a174f3caf071b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e5c82e3988866eab73605204ba3af171.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5b3b4069a90e033475dfa61fa1b74b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b5f1f71fe391628ce283f3a8cdde64b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_b668dc6d579a3afa4a245bf06738132b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_1a444a4477f034add37d879ad66e1bba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_d1f694e2ce1b0a358c3ad9f0dfbae145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_69fcff1bd7b14b5ede28eabc283756b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_e4e86378f0bb353b381c7afcc4411f25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_8c2fe88fd5f7607173aaf254a865d068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_735ca8e7eda38b08142b91e66ed7a907.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_913f8e91-7035-5d56-8beb-2bb1c9a2cfc2/913f8e91-7035-5d56-8beb-2bb1c9a2cfc2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/e8/9ee8fad7dd5d4c113e6d7199f6ee3f17/pa/ZS76119_137c964cc1702c5ef122f9000622eb60.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Maxx 2WD',
 'transmission': 'manual',
 'trim': 'Maxx 2WD',
 'year': 2022}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZS76119%27 HTTP/1.1" 200 None
2026-01-28 17:00:41 [auto1.es] INFO: Saving data for ZS76119: {'created_time': 1769619641.42396, 'last_price_update_time': 1769619641.423972, 'auction_closing_time': 1769705795.0}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZS76119') HTTP/1.1" 204 0
2026-01-28 17:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8f56d113-75d4-5f0e-8fa8-ae567d882343 with identifier: BG39460
2026-01-28 17:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8f56d113-75d4-5f0e-8fa8-ae567d882343 with identifier: BG39460
2026-01-28 17:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8f56d113-75d4-5f0e-8fa8-ae567d882343 with identifier: BG39460 to the API
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG39460>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:33:19Z',
 'fuel_type': 'petrol',
 'id': '8f56d113-75d4-5f0e-8fa8-ae567d882343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG39460',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 52798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG39460%27 HTTP/1.1" 200 None
2026-01-28 17:00:41 [auto1.es] INFO: Saving data for BG39460: {'auction_closing_time': 1769704399.0, 'created_time': 1768982437.459277, 'last_price_update_time': 1769619641.8198}
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG39460') HTTP/1.1" 204 0
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_c9a4a85edf125508f6a37ca325033f6c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_c9a4a85edf125508f6a37ca325033f6c.jpg not downloaded yet
2026-01-28 17:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ61100> (referer: https://www.auto1.com/v1/car-details-view/NZ61100/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC14162> (referer: https://www.auto1.com/v1/car-details-view/AC14162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV94358> (referer: https://www.auto1.com/v1/car-details-view/DV94358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55916157-f787-5e8d-9cdb-72496f6e4c85 with identifier: MN19248
2026-01-28 17:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55916157-f787-5e8d-9cdb-72496f6e4c85 with scrape type 2
2026-01-28 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55916157-f787-5e8d-9cdb-72496f6e4c85 with scrape type 2
2026-01-28 17:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 55916157-f787-5e8d-9cdb-72496f6e4c85, identifier: MN19248
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_02c2c1378b6692233e20b5ed719d9946.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_02c2c1378b6692233e20b5ed719d9946.jpg not downloaded yet
2026-01-28 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 55916157-f787-5e8d-9cdb-72496f6e4c85 with identifier: MN19248
2026-01-28 17:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 55916157-f787-5e8d-9cdb-72496f6e4c85 with identifier: MN19248
2026-01-28 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 144120 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144120
2026-01-28 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 55916157-f787-5e8d-9cdb-72496f6e4c85 spider: auto1.es
2026-01-28 17:00:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 55916157-f787-5e8d-9cdb-72496f6e4c85 due to rule: high_mileage_for_make.json, error: 144120 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    144120
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:16:49Z',
 'fuel_type': 'diesel',
 'id': '55916157-f787-5e8d-9cdb-72496f6e4c85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN19248',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 144120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN19248%27 HTTP/1.1" 200 None
2026-01-28 17:00:42 [auto1.es] INFO: Saving data for MN19248: {'auction_closing_time': 1769703409.0, 'created_time': 1767027740.009754, 'last_price_update_time': 1769619642.212013}
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MN19248') HTTP/1.1" 204 0
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_03feb03138d7388c8a012bc07628d39e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_03feb03138d7388c8a012bc07628d39e.jpg not downloaded yet
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg not downloaded yet
2026-01-28 17:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-01-28 17:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01e7a164-81ed-5170-9c6e-530bda423157 with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01e7a164-81ed-5170-9c6e-530bda423157 with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01e7a164-81ed-5170-9c6e-530bda423157, identifier: NZ61100
2026-01-28 17:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034958f8-22cc-5ee8-9c1e-de52bfc9658f with identifier: AC14162
2026-01-28 17:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034958f8-22cc-5ee8-9c1e-de52bfc9658f with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034958f8-22cc-5ee8-9c1e-de52bfc9658f with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 034958f8-22cc-5ee8-9c1e-de52bfc9658f, identifier: AC14162
2026-01-28 17:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 with identifier: DV94358
2026-01-28 17:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 with scrape type 2
2026-01-28 17:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9, identifier: DV94358
2026-01-28 17:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-01-28 17:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100
2026-01-28 17:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01e7a164-81ed-5170-9c6e-530bda423157 with identifier: NZ61100 to the API
2026-01-28 17:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ61100>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-01-29T16:38:50Z',
 'fuel_type': 'petrol',
 'id': '01e7a164-81ed-5170-9c6e-530bda423157',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ61100',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 62325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ61100%27 HTTP/1.1" 200 None
2026-01-28 17:00:44 [auto1.es] INFO: Saving data for NZ61100: {'auction_closing_time': 1769704730.0, 'created_time': 1768291233.251465, 'last_price_update_time': 1769619644.17021}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ61100') HTTP/1.1" 204 0
2026-01-28 17:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 034958f8-22cc-5ee8-9c1e-de52bfc9658f with identifier: AC14162
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 034958f8-22cc-5ee8-9c1e-de52bfc9658f with identifier: AC14162
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 034958f8-22cc-5ee8-9c1e-de52bfc9658f spider: auto1.es
2026-01-28 17:00:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 034958f8-22cc-5ee8-9c1e-de52bfc9658f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:47:06Z',
 'fuel_type': 'diesel',
 'id': '034958f8-22cc-5ee8-9c1e-de52bfc9658f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC14162',
 'listing': 'auction',
 'location': 'Sevilla',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 130472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2019}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC14162%27 HTTP/1.1" 200 None
2026-01-28 17:00:44 [auto1.es] INFO: Saving data for AC14162: {'auction_closing_time': 1769705226.0, 'created_time': 1769002687.189243, 'last_price_update_time': 1769619644.393835}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC14162') HTTP/1.1" 204 0
2026-01-28 17:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 with identifier: DV94358
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 with identifier: DV94358
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163491
2026-01-28 17:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 spider: auto1.es
2026-01-28 17:00:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7bf79cc9-7379-5ae4-9646-8bb83934c7a9 due to rule: high_mileage_for_country.json, error: 163491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163491
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:48:32Z',
 'fuel_type': 'petrol',
 'id': '7bf79cc9-7379-5ae4-9646-8bb83934c7a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV94358',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 163491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.2 Turbo Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2017}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV94358%27 HTTP/1.1" 200 None
2026-01-28 17:00:44 [auto1.es] INFO: Saving data for DV94358: {'auction_closing_time': 1769705312.0, 'created_time': 1769421730.737, 'last_price_update_time': 1769619644.613422}
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV94358') HTTP/1.1" 204 0
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg not downloaded yet
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_3b7bdda19cf176e6d9a702507821ce10.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV47031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY09840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA44926> (referer: https://www.auto1.com/v1/car-details-view/HA44926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH60246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_dbd0ec3b126f2f024a947ec661072807.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_dbd0ec3b126f2f024a947ec661072807.jpg not downloaded yet
2026-01-28 17:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP05677> (referer: https://www.auto1.com/v1/car-details-view/TP05677/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634cdb10>
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg saved to cache
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_03feb03138d7388c8a012bc07628d39e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_c9a4a85edf125508f6a37ca325033f6c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_38ed9f59827db07f3eefa04a80403ce5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_00c2fc1d107460bec23b95c1b05e3133.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a04d10>
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_3b7bdda19cf176e6d9a702507821ce10.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_3b7bdda19cf176e6d9a702507821ce10.jpg saved to cache
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae141158-ccdb-58a1-803a-8d1788491128 with identifier: HA44926
2026-01-28 17:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae141158-ccdb-58a1-803a-8d1788491128 with scrape type 2
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae141158-ccdb-58a1-803a-8d1788491128 with scrape type 2
2026-01-28 17:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae141158-ccdb-58a1-803a-8d1788491128, identifier: HA44926
2026-01-28 17:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5942b39c-3609-5b19-afe9-bab837be0759 with identifier: TP05677
2026-01-28 17:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5942b39c-3609-5b19-afe9-bab837be0759 with scrape type 2
2026-01-28 17:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5942b39c-3609-5b19-afe9-bab837be0759 with scrape type 2
2026-01-28 17:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5942b39c-3609-5b19-afe9-bab837be0759, identifier: TP05677
2026-01-28 17:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae141158-ccdb-58a1-803a-8d1788491128 with identifier: HA44926
2026-01-28 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae141158-ccdb-58a1-803a-8d1788491128 with identifier: HA44926
2026-01-28 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183882 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183882
2026-01-28 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ae141158-ccdb-58a1-803a-8d1788491128 spider: auto1.es
2026-01-28 17:00:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ae141158-ccdb-58a1-803a-8d1788491128 due to rule: high_mileage_for_country.json, error: 183882 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183882
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:16:46Z',
 'fuel_type': 'diesel',
 'id': 'ae141158-ccdb-58a1-803a-8d1788491128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA44926',
 'listing': 'auction',
 'location': 'ES, Vigo',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 183882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA44926%27 HTTP/1.1" 200 None
2026-01-28 17:00:45 [auto1.es] INFO: Saving data for HA44926: {'auction_closing_time': 1769703406.0, 'created_time': 1769421739.106167, 'last_price_update_time': 1769619645.76079}
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA44926') HTTP/1.1" 204 0
2026-01-28 17:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5942b39c-3609-5b19-afe9-bab837be0759 with identifier: TP05677
2026-01-28 17:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5942b39c-3609-5b19-afe9-bab837be0759 with identifier: TP05677
2026-01-28 17:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5942b39c-3609-5b19-afe9-bab837be0759 with identifier: TP05677 to the API
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP05677>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:03:55Z',
 'fuel_type': 'petrol',
 'id': '5942b39c-3609-5b19-afe9-bab837be0759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP05677',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 93829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium Design',
 'transmission': 'manual',
 'trim': 'Titanium Design',
 'year': 2022}
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP05677%27 HTTP/1.1" 200 None
2026-01-28 17:00:46 [auto1.es] INFO: Saving data for TP05677: {'auction_closing_time': 1769702635.0, 'created_time': 1769101725.270867, 'last_price_update_time': 1769619646.100069}
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP05677') HTTP/1.1" 204 0
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_02c2c1378b6692233e20b5ed719d9946.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_f3eea64b944e43015a72e4316b112f8d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG66200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG19376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC94870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_df001decd3844e8e99544c0ab415e526.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_dbd0ec3b126f2f024a947ec661072807.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f32d0>
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_03feb03138d7388c8a012bc07628d39e.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_03feb03138d7388c8a012bc07628d39e.jpg saved to cache
2026-01-28 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635d89d0>
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg saved to cache
2026-01-28 17:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63526750>
2026-01-28 17:00:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_c9a4a85edf125508f6a37ca325033f6c.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_c9a4a85edf125508f6a37ca325033f6c.jpg saved to cache
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f11d0>
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_38ed9f59827db07f3eefa04a80403ce5.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_38ed9f59827db07f3eefa04a80403ce5.jpg saved to cache
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346ff90>
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_00c2fc1d107460bec23b95c1b05e3133.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_00c2fc1d107460bec23b95c1b05e3133.jpg saved to cache
2026-01-28 17:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e5b90>
2026-01-28 17:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg saved to cache
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d0ad0>
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_02c2c1378b6692233e20b5ed719d9946.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_02c2c1378b6692233e20b5ed719d9946.jpg saved to cache
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340e750>
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_f3eea64b944e43015a72e4316b112f8d.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_f3eea64b944e43015a72e4316b112f8d.jpg saved to cache
2026-01-28 17:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f7910>
2026-01-28 17:00:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg saved to cache
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340e550>
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_df001decd3844e8e99544c0ab415e526.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_df001decd3844e8e99544c0ab415e526.jpg saved to cache
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63336a90>
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg saved to cache
2026-01-28 17:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a08a10>
2026-01-28 17:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_dbd0ec3b126f2f024a947ec661072807.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_dbd0ec3b126f2f024a947ec661072807.jpg saved to cache
2026-01-28 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE57160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC05053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV27185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS46179> (referer: https://www.auto1.com/v1/car-details-view/WS46179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY34370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6ff50>
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg saved to cache
2026-01-28 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_a037ea93e7add0ae219c724528344875.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 with identifier: WS46179
2026-01-28 17:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 with scrape type 2
2026-01-28 17:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 with scrape type 2
2026-01-28 17:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2, identifier: WS46179
2026-01-28 17:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 with identifier: WS46179
2026-01-28 17:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 with identifier: WS46179
2026-01-28 17:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 129967, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ws46179', 'expiration_date': '2026-01-29t16:52:26z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2', 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 129967}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 108,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:52:26z',
     'fuel_type': 'petrol',
     'id': 'cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ws46179',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 129967,
     'odometer_in_km': 129967,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-28 17:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 spider: auto1.es
2026-01-28 17:00:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 129967, 'odometer_reading_unit': 'km', 'registration_date': '2017-01-17', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ws46179', 'expiration_date': '2026-01-29t16:52:26z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 130, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2', 'current_year_diff': 9, 'age_in_months': 108, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 129967}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 108,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 130,
     'expiration_date': '2026-01-29t16:52:26z',
     'fuel_type': 'petrol',
     'id': 'cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ws46179',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 129967,
     'odometer_in_km': 129967,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-01-17',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:52:26Z',
 'fuel_type': 'petrol',
 'id': 'cf677bc7-8f8b-5ec6-99f9-cc389a3b01d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS46179',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 129967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS46179%27 HTTP/1.1" 200 None
2026-01-28 17:00:50 [auto1.es] INFO: Saving data for WS46179: {'auction_closing_time': 1769705546.0, 'created_time': 1768912926.44356, 'last_price_update_time': 1769619650.834525}
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WS46179') HTTP/1.1" 204 0
2026-01-28 17:00:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6a21e5d0>
2026-01-28 17:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf5%252F3b%252Ff53b6ac9a34ab9cf7bc45af02a434391%252Fpa%252FKP04085_a037ea93e7add0ae219c724528344875.jpg') HTTP/1.1" 204 0
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_a037ea93e7add0ae219c724528344875.jpg saved to cache
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f921c0d-0536-5707-9410-42229c5ce8d0
2026-01-28 17:00:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f921c0d-0536-5707-9410-42229c5ce8d0, skipping ID generation
2026-01-28 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f921c0d-0536-5707-9410-42229c5ce8d0 with scrape type 1
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f921c0d-0536-5707-9410-42229c5ce8d0 from tracking dictionaries
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f921c0d-0536-5707-9410-42229c5ce8d0 sending to next pipeline
2026-01-28 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f921c0d-0536-5707-9410-42229c5ce8d0, identifier: KP04085
2026-01-28 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f921c0d-0536-5707-9410-42229c5ce8d0 with identifier: KP04085
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f921c0d-0536-5707-9410-42229c5ce8d0 with identifier: KP04085
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153350 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153350
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7f921c0d-0536-5707-9410-42229c5ce8d0 spider: auto1.es
2026-01-28 17:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7f921c0d-0536-5707-9410-42229c5ce8d0 due to rule: high_mileage_for_country.json, error: 153350 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153350
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:09:32Z',
 'fuel_type': 'petrol',
 'id': '7f921c0d-0536-5707-9410-42229c5ce8d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP04085',
 'listing': 'auction',
 'location': 'ES, Alzira',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 153350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_56724e2f25694bfbeb2370c4ecefdc39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_df001decd3844e8e99544c0ab415e526.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_2cffe67835b4c524b8c198716c6bd4b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_f3eea64b944e43015a72e4316b112f8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_3b7bdda19cf176e6d9a702507821ce10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_a037ea93e7add0ae219c724528344875.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_d3f6a4593e68e9eba7866e4e24eb364d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_38ed9f59827db07f3eefa04a80403ce5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_bd0d3ac651d707b4cc5bd2a7770a8768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_00c2fc1d107460bec23b95c1b05e3133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_c9a4a85edf125508f6a37ca325033f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_02c2c1378b6692233e20b5ed719d9946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_03feb03138d7388c8a012bc07628d39e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_689ba24047cb22d1c6456f8660b5b7d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_69f6fdb83e0c13ff0bde6eefb89099c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f921c0d-0536-5707-9410-42229c5ce8d0/7f921c0d-0536-5707-9410-42229c5ce8d0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85368,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf5/3b/f53b6ac9a34ab9cf7bc45af02a434391/pa/KP04085_dbd0ec3b126f2f024a947ec661072807.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Kona 1.0 TGDI Tecno 2WD',
 'transmission': 'manual',
 'trim': 'Tecno 2WD',
 'year': 2019}
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP04085%27 HTTP/1.1" 200 None
2026-01-28 17:00:51 [auto1.es] INFO: Saving data for KP04085: {'created_time': 1769619651.50946, 'last_price_update_time': 1769619651.509472, 'auction_closing_time': 1769702972.0}
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP04085') HTTP/1.1" 204 0
2026-01-28 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH60246> (referer: https://www.auto1.com/v1/car-details-view/ZH60246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY09840> (referer: https://www.auto1.com/v1/car-details-view/VY09840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV47031> (referer: https://www.auto1.com/v1/car-details-view/GV47031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1239550-caf0-5215-852b-d2f8c631e817 with identifier: ZH60246
2026-01-28 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1239550-caf0-5215-852b-d2f8c631e817 with scrape type 2
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1239550-caf0-5215-852b-d2f8c631e817 with scrape type 2
2026-01-28 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1239550-caf0-5215-852b-d2f8c631e817, identifier: ZH60246
2026-01-28 17:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90eacf31-44d1-5d49-883e-7cb084c147fc with identifier: VY09840
2026-01-28 17:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90eacf31-44d1-5d49-883e-7cb084c147fc with scrape type 2
2026-01-28 17:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90eacf31-44d1-5d49-883e-7cb084c147fc with scrape type 2
2026-01-28 17:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90eacf31-44d1-5d49-883e-7cb084c147fc, identifier: VY09840
2026-01-28 17:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1239550-caf0-5215-852b-d2f8c631e817 with identifier: ZH60246
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1239550-caf0-5215-852b-d2f8c631e817 with identifier: ZH60246
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a1239550-caf0-5215-852b-d2f8c631e817 spider: auto1.es
2026-01-28 17:00:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a1239550-caf0-5215-852b-d2f8c631e817 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:48:30Z',
 'fuel_type': 'diesel',
 'id': 'a1239550-caf0-5215-852b-d2f8c631e817',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH60246',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 121312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-30',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Trend',
 'transmission': 'manual',
 'trim': '310 L1 Trend',
 'year': 2017}
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH60246%27 HTTP/1.1" 200 None
2026-01-28 17:00:52 [auto1.es] INFO: Saving data for ZH60246: {'auction_closing_time': 1769705310.0, 'created_time': 1768401515.910097, 'last_price_update_time': 1769619652.060314}
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH60246') HTTP/1.1" 204 0
2026-01-28 17:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90eacf31-44d1-5d49-883e-7cb084c147fc with identifier: VY09840
2026-01-28 17:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90eacf31-44d1-5d49-883e-7cb084c147fc with identifier: VY09840
2026-01-28 17:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90eacf31-44d1-5d49-883e-7cb084c147fc with identifier: VY09840 to the API
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VY09840>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:26:22Z',
 'fuel_type': 'diesel',
 'id': '90eacf31-44d1-5d49-883e-7cb084c147fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY09840',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 4498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY09840%27 HTTP/1.1" 200 None
2026-01-28 17:00:52 [auto1.es] INFO: Saving data for VY09840: {'auction_closing_time': 1769703982.0, 'created_time': 1769002555.364465, 'last_price_update_time': 1769619652.667284}
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY09840') HTTP/1.1" 204 0
2026-01-28 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT03911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP05914> (referer: https://www.auto1.com/v1/car-details-view/DP05914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ccc1e24-7189-5772-8d6b-9fdc359c663b with identifier: GV47031
2026-01-28 17:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ccc1e24-7189-5772-8d6b-9fdc359c663b with scrape type 2
2026-01-28 17:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ccc1e24-7189-5772-8d6b-9fdc359c663b with scrape type 2
2026-01-28 17:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ccc1e24-7189-5772-8d6b-9fdc359c663b, identifier: GV47031
2026-01-28 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG40177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV73923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ccc1e24-7189-5772-8d6b-9fdc359c663b with identifier: GV47031
2026-01-28 17:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ccc1e24-7189-5772-8d6b-9fdc359c663b with identifier: GV47031
2026-01-28 17:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ccc1e24-7189-5772-8d6b-9fdc359c663b with identifier: GV47031 to the API
2026-01-28 17:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GV47031>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:55Z',
 'fuel_type': 'petrol',
 'id': '8ccc1e24-7189-5772-8d6b-9fdc359c663b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV47031',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 38795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV47031%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Saving data for GV47031: {'auction_closing_time': 1769705095.0, 'created_time': 1769065283.978135, 'last_price_update_time': 1769619653.391943}
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV47031') HTTP/1.1" 204 0
2026-01-28 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24709db-8ac3-544b-b6d2-22e9dabde2ac with identifier: DP05914
2026-01-28 17:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24709db-8ac3-544b-b6d2-22e9dabde2ac with scrape type 2
2026-01-28 17:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24709db-8ac3-544b-b6d2-22e9dabde2ac with scrape type 2
2026-01-28 17:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c24709db-8ac3-544b-b6d2-22e9dabde2ac, identifier: DP05914
2026-01-28 17:00:53 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c24709db-8ac3-544b-b6d2-22e9dabde2ac with identifier: DP05914
2026-01-28 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c24709db-8ac3-544b-b6d2-22e9dabde2ac with identifier: DP05914
2026-01-28 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178824 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178824
2026-01-28 17:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c24709db-8ac3-544b-b6d2-22e9dabde2ac spider: auto1.es
2026-01-28 17:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c24709db-8ac3-544b-b6d2-22e9dabde2ac due to rule: high_mileage_for_country.json, error: 178824 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178824
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:20:26Z',
 'fuel_type': 'diesel',
 'id': 'c24709db-8ac3-544b-b6d2-22e9dabde2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP05914',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 178824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI R-Line BlueMotion',
 'transmission': 'automatic',
 'trim': 'R-Line BlueMotion',
 'year': 2018}
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP05914%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Saving data for DP05914: {'auction_closing_time': 1769703626.0, 'created_time': 1769421630.657426, 'last_price_update_time': 1769619653.729411}
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DP05914') HTTP/1.1" 204 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: UB02402
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB02402%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for UB02402: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: WU73212
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU73212%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for WU73212: 2
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: CU12578
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU12578%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for CU12578: 2
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: WT01981
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT01981%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for WT01981: 2
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: FG99809
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG99809%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for FG99809: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: NS14217
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS14217%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for NS14217: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: GZ65058
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ65058%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for GZ65058: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: LW57020
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW57020%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for LW57020: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: TX26882
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX26882%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for TX26882: 2
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: NJ49503
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ49503%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for NJ49503: 2
2026-01-28 17:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX94287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: XW22708
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW22708%27 HTTP/1.1" 200 None
2026-01-28 17:00:53 [auto1.es] INFO: Scrape type for XW22708: 0
2026-01-28 17:00:53 [auto1.es] INFO: Found listing with ID: NF50708
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF50708%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for NF50708: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: HE35950
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE35950%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for HE35950: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: CY53748
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CY53748%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for CY53748: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: ED56686
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED56686%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for ED56686: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: SU61206
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU61206%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for SU61206: 2
2026-01-28 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW10674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: RE96248
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE96248%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for RE96248: 2
2026-01-28 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: XF61793
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF61793%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for XF61793: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: TL27510
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL27510%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for TL27510: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: VT82415
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT82415%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for VT82415: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: AE10228
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE10228%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for AE10228: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: CX32181
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX32181%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for CX32181: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: BE03289
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE03289%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for BE03289: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: KL70235
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL70235%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for KL70235: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: CC08636
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08636%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for CC08636: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: JW38113
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW38113%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for JW38113: 2
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: ZK67918
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK67918%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for ZK67918: 2
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: CV57144
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV57144%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for CV57144: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: UK95228
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK95228%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for UK95228: 2
2026-01-28 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC94870> (referer: https://www.auto1.com/v1/car-details-view/ZC94870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: US12212
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US12212%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for US12212: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: DU20801
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU20801%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for DU20801: 2
2026-01-28 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: YF88896
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF88896%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for YF88896: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: YL72553
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL72553%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for YL72553: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: GA59266
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GA59266%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for GA59266: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: FG66132
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG66132%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for FG66132: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: GY56775
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY56775%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for GY56775: 2
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: TH66147
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH66147%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for TH66147: 2
2026-01-28 17:00:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW69115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: RA35771
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RA35771%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for RA35771: 0
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: LY93343
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY93343%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for LY93343: 2
2026-01-28 17:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b800f51-50a2-5776-910b-94fc81431359 with identifier: ZC94870
2026-01-28 17:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b800f51-50a2-5776-910b-94fc81431359 with scrape type 2
2026-01-28 17:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b800f51-50a2-5776-910b-94fc81431359 with scrape type 2
2026-01-28 17:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0b800f51-50a2-5776-910b-94fc81431359, identifier: ZC94870
2026-01-28 17:00:54 [auto1.es] INFO: Found listing with ID: KM63041
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM63041%27 HTTP/1.1" 200 None
2026-01-28 17:00:54 [auto1.es] INFO: Scrape type for KM63041: 2
2026-01-28 17:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0b800f51-50a2-5776-910b-94fc81431359 with identifier: ZC94870
2026-01-28 17:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0b800f51-50a2-5776-910b-94fc81431359 with identifier: ZC94870
2026-01-28 17:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0b800f51-50a2-5776-910b-94fc81431359 with identifier: ZC94870 to the API
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC94870>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:04:31Z',
 'fuel_type': 'petrol',
 'id': '0b800f51-50a2-5776-910b-94fc81431359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC94870',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 119355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC94870%27 HTTP/1.1" 200 None
2026-01-28 17:00:55 [auto1.es] INFO: Saving data for ZC94870: {'auction_closing_time': 1769702671.0, 'created_time': 1769518915.406935, 'last_price_update_time': 1769619655.037528}
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC94870') HTTP/1.1" 204 0
2026-01-28 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY34370> (referer: https://www.auto1.com/v1/car-details-view/BY34370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG19376> (referer: https://www.auto1.com/v1/car-details-view/HG19376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF10969> (referer: https://www.auto1.com/v1/car-details-view/BF10969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG79943/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 304b04a5-9308-50b4-a90b-795129de636b with identifier: BY34370
2026-01-28 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 304b04a5-9308-50b4-a90b-795129de636b with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 304b04a5-9308-50b4-a90b-795129de636b with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 304b04a5-9308-50b4-a90b-795129de636b, identifier: BY34370
2026-01-28 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce72cda1-df47-5d46-97a5-2011fa145079 with identifier: HG19376
2026-01-28 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce72cda1-df47-5d46-97a5-2011fa145079 with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce72cda1-df47-5d46-97a5-2011fa145079 with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce72cda1-df47-5d46-97a5-2011fa145079, identifier: HG19376
2026-01-28 17:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d3d0cee-cf69-51ba-960c-44a473dc3345 with identifier: BF10969
2026-01-28 17:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3d0cee-cf69-51ba-960c-44a473dc3345 with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d3d0cee-cf69-51ba-960c-44a473dc3345 with scrape type 2
2026-01-28 17:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d3d0cee-cf69-51ba-960c-44a473dc3345, identifier: BF10969
2026-01-28 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 304b04a5-9308-50b4-a90b-795129de636b with identifier: BY34370
2026-01-28 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 304b04a5-9308-50b4-a90b-795129de636b with identifier: BY34370
2026-01-28 17:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 304b04a5-9308-50b4-a90b-795129de636b with identifier: BY34370 to the API
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BY34370>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:05:20Z',
 'fuel_type': 'petrol',
 'id': '304b04a5-9308-50b4-a90b-795129de636b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY34370',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 70212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.0 TGDi Longitude 4x2',
 'transmission': 'manual',
 'trim': 'Longitude 4x2',
 'year': 2021}
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY34370%27 HTTP/1.1" 200 None
2026-01-28 17:00:55 [auto1.es] INFO: Saving data for BY34370: {'auction_closing_time': 1769702720.0, 'created_time': 1768401079.891187, 'last_price_update_time': 1769619655.959835}
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BY34370') HTTP/1.1" 204 0
2026-01-28 17:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce72cda1-df47-5d46-97a5-2011fa145079 with identifier: HG19376
2026-01-28 17:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce72cda1-df47-5d46-97a5-2011fa145079 with identifier: HG19376
2026-01-28 17:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce72cda1-df47-5d46-97a5-2011fa145079 with identifier: HG19376 to the API
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG19376>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:44:42Z',
 'fuel_type': 'diesel',
 'id': 'ce72cda1-df47-5d46-97a5-2011fa145079',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG19376',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 101355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-28',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Business +',
 'transmission': 'automatic',
 'trim': 'Business +',
 'year': 2019}
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG19376%27 HTTP/1.1" 200 None
2026-01-28 17:00:56 [auto1.es] INFO: Saving data for HG19376: {'auction_closing_time': 1769705082.0, 'created_time': 1767373273.754679, 'last_price_update_time': 1769619656.399123}
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG19376') HTTP/1.1" 204 0
2026-01-28 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d3d0cee-cf69-51ba-960c-44a473dc3345 with identifier: BF10969
2026-01-28 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d3d0cee-cf69-51ba-960c-44a473dc3345 with identifier: BF10969
2026-01-28 17:00:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d3d0cee-cf69-51ba-960c-44a473dc3345 with identifier: BF10969 to the API
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BF10969>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:35:34Z',
 'fuel_type': 'petrol',
 'id': '4d3d0cee-cf69-51ba-960c-44a473dc3345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF10969',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 82,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort 4x2',
 'transmission': 'manual',
 'trim': 'Comfort 4x2',
 'year': 2025}
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF10969%27 HTTP/1.1" 200 None
2026-01-28 17:00:56 [auto1.es] INFO: Saving data for BF10969: {'auction_closing_time': 1769704534.0, 'created_time': 1769187773.761873, 'last_price_update_time': 1769619656.695591}
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BF10969') HTTP/1.1" 204 0
2026-01-28 17:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV27185> (referer: https://www.auto1.com/v1/car-details-view/PV27185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC05053> (referer: https://www.auto1.com/v1/car-details-view/GC05053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG66200> (referer: https://www.auto1.com/v1/car-details-view/UG66200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7805b162-07c1-591b-a8c9-5132b01a5f1f with identifier: PV27185
2026-01-28 17:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7805b162-07c1-591b-a8c9-5132b01a5f1f with scrape type 2
2026-01-28 17:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7805b162-07c1-591b-a8c9-5132b01a5f1f with scrape type 2
2026-01-28 17:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7805b162-07c1-591b-a8c9-5132b01a5f1f, identifier: PV27185
2026-01-28 17:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7805b162-07c1-591b-a8c9-5132b01a5f1f with identifier: PV27185
2026-01-28 17:00:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7805b162-07c1-591b-a8c9-5132b01a5f1f with identifier: PV27185
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171360 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171360
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7805b162-07c1-591b-a8c9-5132b01a5f1f spider: auto1.es
2026-01-28 17:00:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7805b162-07c1-591b-a8c9-5132b01a5f1f due to rule: high_mileage_for_country.json, error: 171360 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171360
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-01-29T16:58:56Z',
 'fuel_type': 'diesel',
 'id': '7805b162-07c1-591b-a8c9-5132b01a5f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV27185',
 'listing': 'auction',
 'location': 'Palma de Mallorca',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 171360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2018}
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PV27185%27 HTTP/1.1" 200 None
2026-01-28 17:00:57 [auto1.es] INFO: Saving data for PV27185: {'auction_closing_time': 1769705936.0, 'created_time': 1769518625.907283, 'last_price_update_time': 1769619657.124745}
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PV27185') HTTP/1.1" 204 0
2026-01-28 17:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e999c9-fa89-531f-b61c-5cc7b50e260d with identifier: GC05053
2026-01-28 17:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e999c9-fa89-531f-b61c-5cc7b50e260d with scrape type 2
2026-01-28 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2e999c9-fa89-531f-b61c-5cc7b50e260d with scrape type 2
2026-01-28 17:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d2e999c9-fa89-531f-b61c-5cc7b50e260d, identifier: GC05053
2026-01-28 17:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1909cd26-cce5-58d8-9138-d6f2ce13648a with identifier: UG66200
2026-01-28 17:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1909cd26-cce5-58d8-9138-d6f2ce13648a with scrape type 2
2026-01-28 17:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1909cd26-cce5-58d8-9138-d6f2ce13648a with scrape type 2
2026-01-28 17:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1909cd26-cce5-58d8-9138-d6f2ce13648a, identifier: UG66200
2026-01-28 17:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d2e999c9-fa89-531f-b61c-5cc7b50e260d with identifier: GC05053
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d2e999c9-fa89-531f-b61c-5cc7b50e260d with identifier: GC05053
2026-01-28 17:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d2e999c9-fa89-531f-b61c-5cc7b50e260d with identifier: GC05053 to the API
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC05053>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:29:33Z',
 'fuel_type': 'petrol',
 'id': 'd2e999c9-fa89-531f-b61c-5cc7b50e260d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC05053',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 11952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2023}
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC05053%27 HTTP/1.1" 200 None
2026-01-28 17:00:57 [auto1.es] INFO: Saving data for GC05053: {'auction_closing_time': 1769704173.0, 'created_time': 1769003329.678628, 'last_price_update_time': 1769619657.864813}
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GC05053') HTTP/1.1" 204 0
2026-01-28 17:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1909cd26-cce5-58d8-9138-d6f2ce13648a with identifier: UG66200
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1909cd26-cce5-58d8-9138-d6f2ce13648a with identifier: UG66200
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 58119, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug66200', 'expiration_date': '2026-01-29t16:53:08z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': '1909cd26-cce5-58d8-9138-d6f2ce13648a', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58119}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:53:08z',
     'fuel_type': 'petrol',
     'id': '1909cd26-cce5-58d8-9138-d6f2ce13648a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug66200',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 58119,
     'odometer_in_km': 58119,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2026-01-28 17:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 1909cd26-cce5-58d8-9138-d6f2ce13648a spider: auto1.es
2026-01-28 17:00:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1909cd26-cce5-58d8-9138-d6f2ce13648a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 58119, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug66200', 'expiration_date': '2026-01-29t16:53:08z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': '1909cd26-cce5-58d8-9138-d6f2ce13648a', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 58119}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:53:08z',
     'fuel_type': 'petrol',
     'id': '1909cd26-cce5-58d8-9138-d6f2ce13648a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ug66200',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 58119,
     'odometer_in_km': 58119,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:53:08Z',
 'fuel_type': 'petrol',
 'id': '1909cd26-cce5-58d8-9138-d6f2ce13648a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG66200',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 58119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG66200%27 HTTP/1.1" 200 None
2026-01-28 17:00:58 [auto1.es] INFO: Saving data for UG66200: {'auction_closing_time': 1769705588.0, 'created_time': 1767619407.377341, 'last_price_update_time': 1769619658.110343}
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG66200') HTTP/1.1" 204 0
2026-01-28 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN74172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG40177> (referer: https://www.auto1.com/v1/car-details-view/UG40177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV73923> (referer: https://www.auto1.com/v1/car-details-view/KV73923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE57160> (referer: https://www.auto1.com/v1/car-details-view/BE57160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 with identifier: UG40177
2026-01-28 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 with scrape type 2
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 with scrape type 2
2026-01-28 17:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75, identifier: UG40177
2026-01-28 17:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 with identifier: UG40177
2026-01-28 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 with identifier: UG40177
2026-01-28 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 140244 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140244
2026-01-28 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 spider: auto1.es
2026-01-28 17:00:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0e7d70a3-aacf-5faa-8e1c-706cc9569b75 due to rule: high_mileage_for_make.json, error: 140244 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    140244
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:48:39Z',
 'fuel_type': 'diesel',
 'id': '0e7d70a3-aacf-5faa-8e1c-706cc9569b75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG40177',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 140244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Diesel R-Dynamic',
 'transmission': 'automatic',
 'trim': 'R-Dynamic',
 'year': 2020}
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG40177%27 HTTP/1.1" 200 None
2026-01-28 17:00:58 [auto1.es] INFO: Saving data for UG40177: {'auction_closing_time': 1769705319.0, 'created_time': 1768052233.010143, 'last_price_update_time': 1769619658.561701}
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG40177') HTTP/1.1" 204 0
2026-01-28 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de44298-487d-5744-9937-ebe4151c540d with identifier: KV73923
2026-01-28 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de44298-487d-5744-9937-ebe4151c540d with scrape type 1
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_87f85446cd44406f52834e680433a08a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg not downloaded yet
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg not downloaded yet
2026-01-28 17:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24e1069-14be-5436-b9cf-8539c27b38fa with identifier: BE57160
2026-01-28 17:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24e1069-14be-5436-b9cf-8539c27b38fa with scrape type 2
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c24e1069-14be-5436-b9cf-8539c27b38fa with scrape type 2
2026-01-28 17:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c24e1069-14be-5436-b9cf-8539c27b38fa, identifier: BE57160
2026-01-28 17:00:58 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_3b07f6ae6bd467fca433a36246d134e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg not downloaded yet
2026-01-28 17:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c24e1069-14be-5436-b9cf-8539c27b38fa with identifier: BE57160
2026-01-28 17:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c24e1069-14be-5436-b9cf-8539c27b38fa with identifier: BE57160
2026-01-28 17:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c24e1069-14be-5436-b9cf-8539c27b38fa with identifier: BE57160 to the API
2026-01-28 17:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE57160>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:33:26Z',
 'fuel_type': 'petrol',
 'id': 'c24e1069-14be-5436-b9cf-8539c27b38fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE57160',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 17306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2017}
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE57160%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Saving data for BE57160: {'auction_closing_time': 1769704406.0, 'created_time': 1768825861.627924, 'last_price_update_time': 1769619659.152439}
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE57160') HTTP/1.1" 204 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: VL30492
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VL30492%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for VL30492: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: KG26344
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG26344%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for KG26344: 2
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg not downloaded yet
2026-01-28 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK95228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ49503/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: BF08538
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF08538%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for BF08538: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: ZF96743
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF96743%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for ZF96743: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: WS86434
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS86434%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for WS86434: 2
2026-01-28 17:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU61206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_049136f610145b3c05a021312f49c4ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg not downloaded yet
2026-01-28 17:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: ED37556
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED37556%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for ED37556: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: EM95708
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM95708%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for EM95708: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: LW64102
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW64102%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for LW64102: 2
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg not downloaded yet
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: BC35666
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BC35666%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for BC35666: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: EM06663
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM06663%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for EM06663: 2
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg not downloaded yet
2026-01-28 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: KY09670
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY09670%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for KY09670: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: YU78532
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU78532%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for YU78532: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: FP86933
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP86933%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for FP86933: 2
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg not downloaded yet
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: SW12423
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW12423%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for SW12423: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: PK59036
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK59036%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for PK59036: 2
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg not downloaded yet
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: JG40815
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG40815%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for JG40815: 0
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: UG23726
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG23726%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for UG23726: 1
2026-01-28 17:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_1c1217d05d1ea1b4c0576a605013b302.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg not downloaded yet
2026-01-28 17:00:59 [auto1.es] INFO: Found listing with ID: XP82584
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP82584%27 HTTP/1.1" 200 None
2026-01-28 17:00:59 [auto1.es] INFO: Scrape type for XP82584: 2
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a57a50>
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:00:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:00:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_3b07f6ae6bd467fca433a36246d134e1.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg saved to cache
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_85cf9609abfe713e89805495c152acfc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg not downloaded yet
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: AM59619
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM59619%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for AM59619: 1
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg not downloaded yet
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU20801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY93343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY56775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635fa2d0>
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg saved to cache
2026-01-28 17:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: WP71520
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WP71520%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for WP71520: 0
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: HA61855
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA61855%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for HA61855: 2
2026-01-28 17:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM63041/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: XL84639
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL84639%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for XL84639: 1
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: GC76681
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC76681%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for GC76681: 2
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: YC50335
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC50335%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for YC50335: 2
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: SM01483
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM01483%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for SM01483: 1
2026-01-28 17:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: VA43788
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA43788%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for VA43788: 0
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: PU03197
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU03197%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for PU03197: 2
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: JC35569
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC35569%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for JC35569: 0
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: RL43242
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RL43242%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for RL43242: 0
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: NN20547
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN20547%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for NN20547: 2
2026-01-28 17:01:00 [auto1.es] INFO: Found listing with ID: DM90018
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-01-28 17:01:00 [auto1.es] INFO: Scrape type for DM90018: 2
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634df750>
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg saved to cache
2026-01-28 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: NT71551
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT71551%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for NT71551: 2
2026-01-28 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW69115> (referer: https://www.auto1.com/v1/car-details-view/BW69115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG79943> (referer: https://www.auto1.com/v1/car-details-view/ZG79943/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW10674> (referer: https://www.auto1.com/v1/car-details-view/HW10674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346aed0>
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_85cf9609abfe713e89805495c152acfc.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg saved to cache
2026-01-28 17:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: AB95779
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB95779%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for AB95779: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: HC46230
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC46230%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for HC46230: 2
2026-01-28 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: WM01102
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WM01102%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for WM01102: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: GP26464
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GP26464%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for GP26464: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: BE20116
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE20116%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for BE20116: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: UG26866
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG26866%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for UG26866: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: TB21546
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB21546%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for TB21546: 0
2026-01-28 17:01:01 [auto1.es] INFO: Found listing with ID: UM59294
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM59294%27 HTTP/1.1" 200 None
2026-01-28 17:01:01 [auto1.es] INFO: Scrape type for UM59294: 2
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63648fd0>
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg saved to cache
2026-01-28 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3efc5337-ef7d-5060-937a-cb5ecbd34163 with identifier: BW69115
2026-01-28 17:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3efc5337-ef7d-5060-937a-cb5ecbd34163 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3efc5337-ef7d-5060-937a-cb5ecbd34163 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3efc5337-ef7d-5060-937a-cb5ecbd34163, identifier: BW69115
2026-01-28 17:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633868a4-a132-5e7f-b79d-b745e35b6873 with identifier: ZG79943
2026-01-28 17:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633868a4-a132-5e7f-b79d-b745e35b6873 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 633868a4-a132-5e7f-b79d-b745e35b6873 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 633868a4-a132-5e7f-b79d-b745e35b6873, identifier: ZG79943
2026-01-28 17:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7e0143e-e0be-5f99-8742-25e266d117a7 with identifier: HW10674
2026-01-28 17:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7e0143e-e0be-5f99-8742-25e266d117a7 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7e0143e-e0be-5f99-8742-25e266d117a7 with scrape type 2
2026-01-28 17:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f7e0143e-e0be-5f99-8742-25e266d117a7, identifier: HW10674
2026-01-28 17:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3efc5337-ef7d-5060-937a-cb5ecbd34163 with identifier: BW69115
2026-01-28 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3efc5337-ef7d-5060-937a-cb5ecbd34163 with identifier: BW69115
2026-01-28 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171297 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171297
2026-01-28 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3efc5337-ef7d-5060-937a-cb5ecbd34163 spider: auto1.es
2026-01-28 17:01:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3efc5337-ef7d-5060-937a-cb5ecbd34163 due to rule: high_mileage_for_country.json, error: 171297 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171297
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:34:12Z',
 'fuel_type': 'diesel',
 'id': '3efc5337-ef7d-5060-937a-cb5ecbd34163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW69115',
 'listing': 'auction',
 'location': 'Roces',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 171297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2018}
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW69115%27 HTTP/1.1" 200 None
2026-01-28 17:01:02 [auto1.es] INFO: Saving data for BW69115: {'auction_closing_time': 1769704452.0, 'created_time': 1769015019.974349, 'last_price_update_time': 1769619662.673797}
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BW69115') HTTP/1.1" 204 0
2026-01-28 17:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 633868a4-a132-5e7f-b79d-b745e35b6873 with identifier: ZG79943
2026-01-28 17:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 633868a4-a132-5e7f-b79d-b745e35b6873 with identifier: ZG79943
2026-01-28 17:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 633868a4-a132-5e7f-b79d-b745e35b6873 with identifier: ZG79943 to the API
2026-01-28 17:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG79943>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:18:25Z',
 'fuel_type': 'diesel',
 'id': '633868a4-a132-5e7f-b79d-b745e35b6873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG79943',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 101088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.6 TDI FR Edition',
 'transmission': 'manual',
 'trim': 'FR Edition',
 'year': 2019}
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG79943%27 HTTP/1.1" 200 None
2026-01-28 17:01:03 [auto1.es] INFO: Saving data for ZG79943: {'auction_closing_time': 1769703505.0, 'created_time': 1768975301.240242, 'last_price_update_time': 1769619663.155719}
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG79943') HTTP/1.1" 204 0
2026-01-28 17:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f7e0143e-e0be-5f99-8742-25e266d117a7 with identifier: HW10674
2026-01-28 17:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f7e0143e-e0be-5f99-8742-25e266d117a7 with identifier: HW10674
2026-01-28 17:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f7e0143e-e0be-5f99-8742-25e266d117a7 with identifier: HW10674 to the API
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW10674>
{'auction_title': '',
 'c_o_2_emission_value': 181,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-01-29T16:57:06Z',
 'fuel_type': 'diesel',
 'id': 'f7e0143e-e0be-5f99-8742-25e266d117a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW10674',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 119365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 TD Sd4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2018}
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HW10674%27 HTTP/1.1" 200 None
2026-01-28 17:01:03 [auto1.es] INFO: Saving data for HW10674: {'auction_closing_time': 1769705826.0, 'created_time': 1769421679.675003, 'last_price_update_time': 1769619663.600708}
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HW10674') HTTP/1.1" 204 0
2026-01-28 17:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK67918/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE96248/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX94287> (referer: https://www.auto1.com/v1/car-details-view/WX94287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2026-01-28 17:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with scrape type 2
2026-01-28 17:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with scrape type 2
2026-01-28 17:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9, identifier: WX94287
2026-01-28 17:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2026-01-28 17:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287
2026-01-28 17:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d737a7b6-e857-56a1-9ae2-f9ae1ff866b9 with identifier: WX94287 to the API
2026-01-28 17:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WX94287>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:00:09Z',
 'fuel_type': 'diesel',
 'id': 'd737a7b6-e857-56a1-9ae2-f9ae1ff866b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX94287',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 129412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2018}
2026-01-28 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WX94287%27 HTTP/1.1" 200 None
2026-01-28 17:01:04 [auto1.es] INFO: Saving data for WX94287: {'auction_closing_time': 1769702409.0, 'created_time': 1767632533.027146, 'last_price_update_time': 1769619664.171914}
2026-01-28 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WX94287') HTTP/1.1" 204 0
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH66147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.extensions.logstats] INFO: Crawled 137 pages (at 137 pages/min), scraped 34 items (at 34 items/min)
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG26344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM01483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM06663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TX26882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP82584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA61855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM59619/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM59294/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT71551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU03197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN20547/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC46230/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW38113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM63041> (referer: https://www.auto1.com/v1/car-details-view/KM63041/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0f359a9-7280-5017-b8b1-e87035cab16b with identifier: KM63041
2026-01-28 17:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0f359a9-7280-5017-b8b1-e87035cab16b with scrape type 2
2026-01-28 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0f359a9-7280-5017-b8b1-e87035cab16b with scrape type 2
2026-01-28 17:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0f359a9-7280-5017-b8b1-e87035cab16b, identifier: KM63041
2026-01-28 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0f359a9-7280-5017-b8b1-e87035cab16b with identifier: KM63041
2026-01-28 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0f359a9-7280-5017-b8b1-e87035cab16b with identifier: KM63041
2026-01-28 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175627 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175627
2026-01-28 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b0f359a9-7280-5017-b8b1-e87035cab16b spider: auto1.es
2026-01-28 17:01:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b0f359a9-7280-5017-b8b1-e87035cab16b due to rule: high_mileage_for_country.json, error: 175627 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175627
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:28:53Z',
 'fuel_type': 'diesel',
 'id': 'b0f359a9-7280-5017-b8b1-e87035cab16b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM63041',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 175627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM63041%27 HTTP/1.1" 200 None
2026-01-28 17:01:06 [auto1.es] INFO: Saving data for KM63041: {'auction_closing_time': 1769704133.0, 'created_time': 1769421893.44665, 'last_price_update_time': 1769619666.388078}
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KM63041') HTTP/1.1" 204 0
2026-01-28 17:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE96248> (referer: https://www.auto1.com/v1/car-details-view/RE96248/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with identifier: RE96248
2026-01-28 17:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with scrape type 2
2026-01-28 17:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with scrape type 2
2026-01-28 17:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f87813a-ab7a-55c6-ab9d-2465837f42c0, identifier: RE96248
2026-01-28 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with identifier: RE96248
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-01-28 17:01:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with identifier: RE96248
2026-01-28 17:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f87813a-ab7a-55c6-ab9d-2465837f42c0 with identifier: RE96248 to the API
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RE96248>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:16:44Z',
 'fuel_type': 'hybrid',
 'id': '4f87813a-ab7a-55c6-ab9d-2465837f42c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE96248',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 27241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Adventure',
 'transmission': 'automatic',
 'trim': 'AWD-i Adventure',
 'year': 2023}
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RE96248%27 HTTP/1.1" 200 None
2026-01-28 17:01:07 [auto1.es] INFO: Saving data for RE96248: {'auction_closing_time': 1769703404.0, 'created_time': 1769003586.448845, 'last_price_update_time': 1769619667.212513}
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RE96248') HTTP/1.1" 204 0
2026-01-28 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC76681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH66147> (referer: https://www.auto1.com/v1/car-details-view/TH66147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC50335/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM01483> (referer: https://www.auto1.com/v1/car-details-view/SM01483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG26344> (referer: https://www.auto1.com/v1/car-details-view/KG26344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a772cb27-5079-5147-acbf-ceaa23fa2917 with identifier: TH66147
2026-01-28 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a772cb27-5079-5147-acbf-ceaa23fa2917 with scrape type 2
2026-01-28 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a772cb27-5079-5147-acbf-ceaa23fa2917 with scrape type 2
2026-01-28 17:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a772cb27-5079-5147-acbf-ceaa23fa2917, identifier: TH66147
2026-01-28 17:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a772cb27-5079-5147-acbf-ceaa23fa2917 with identifier: TH66147
2026-01-28 17:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a772cb27-5079-5147-acbf-ceaa23fa2917 with identifier: TH66147
2026-01-28 17:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a772cb27-5079-5147-acbf-ceaa23fa2917 spider: auto1.es
2026-01-28 17:01:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a772cb27-5079-5147-acbf-ceaa23fa2917 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:03:48Z',
 'fuel_type': 'diesel',
 'id': 'a772cb27-5079-5147-acbf-ceaa23fa2917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH66147',
 'listing': 'auction',
 'location': 'ES, Cáceres',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 197825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH66147%27 HTTP/1.1" 200 None
2026-01-28 17:01:07 [auto1.es] INFO: Saving data for TH66147: {'auction_closing_time': 1769702628.0, 'created_time': 1769519058.675665, 'last_price_update_time': 1769619667.642747}
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH66147') HTTP/1.1" 204 0
2026-01-28 17:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ee87e64-3473-50c0-9f37-b4f34a75e238 with identifier: SM01483
2026-01-28 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee87e64-3473-50c0-9f37-b4f34a75e238 with scrape type 1
2026-01-28 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_1107d6902f93b2e39fd9f898da280bcb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_1107d6902f93b2e39fd9f898da280bcb.jpg not downloaded yet
2026-01-28 17:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with identifier: KG26344
2026-01-28 17:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with scrape type 2
2026-01-28 17:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with scrape type 2
2026-01-28 17:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9549b9c2-ce74-5de1-b8d9-3b1f4393c001, identifier: KG26344
2026-01-28 17:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with identifier: KG26344
2026-01-28 17:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with identifier: KG26344
2026-01-28 17:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9549b9c2-ce74-5de1-b8d9-3b1f4393c001 with identifier: KG26344 to the API
2026-01-28 17:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG26344>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:03:09Z',
 'fuel_type': 'petrol',
 'id': '9549b9c2-ce74-5de1-b8d9-3b1f4393c001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG26344',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Fiat',
 'model': '500',
 'odometer': 91254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG26344%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [auto1.es] INFO: Saving data for KG26344: {'auction_closing_time': 1769702589.0, 'created_time': 1769101659.079365, 'last_price_update_time': 1769619668.143903}
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG26344') HTTP/1.1" 204 0
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_a39758671721eb106164c8cfa4360c37.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_a39758671721eb106164c8cfa4360c37.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_5a886115ec72ab01af9a2873a9967db8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_5a886115ec72ab01af9a2873a9967db8.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_466713d13f4418a4438056513bb81c59.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_466713d13f4418a4438056513bb81c59.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_9b0137417a749c5f650864c463bfaa91.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9b0137417a749c5f650864c463bfaa91.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_548386fc53be29280ce6dbe8cf265951.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_548386fc53be29280ce6dbe8cf265951.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_82ee1accccbf9688aa024577d1e10aff.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_82ee1accccbf9688aa024577d1e10aff.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_f4ed312977558397ced5eed0eed1af8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f4ed312977558397ced5eed0eed1af8d.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_e6e31ffdcce386beba9a4f971d405e70.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_e6e31ffdcce386beba9a4f971d405e70.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_80f580ba6a6464245fa6d16dda3c7184.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_80f580ba6a6464245fa6d16dda3c7184.jpg not downloaded yet
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg not downloaded yet
2026-01-28 17:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP82584> (referer: https://www.auto1.com/v1/car-details-view/XP82584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e5f30e-530d-5a76-9c20-2d0b72345af5 with identifier: XP82584
2026-01-28 17:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e5f30e-530d-5a76-9c20-2d0b72345af5 with scrape type 2
2026-01-28 17:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e5f30e-530d-5a76-9c20-2d0b72345af5 with scrape type 2
2026-01-28 17:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40e5f30e-530d-5a76-9c20-2d0b72345af5, identifier: XP82584
2026-01-28 17:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40e5f30e-530d-5a76-9c20-2d0b72345af5 with identifier: XP82584
2026-01-28 17:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40e5f30e-530d-5a76-9c20-2d0b72345af5 with identifier: XP82584
2026-01-28 17:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40e5f30e-530d-5a76-9c20-2d0b72345af5 with identifier: XP82584 to the API
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%2740e5f30e-530d-5a76-9c20-2d0b72345af5%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 40e5f30e-530d-5a76-9c20-2d0b72345af5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:01:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XP82584>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:19:20Z',
 'fuel_type': 'diesel',
 'id': '40e5f30e-530d-5a76-9c20-2d0b72345af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP82584',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2024}
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XP82584%27 HTTP/1.1" 200 None
2026-01-28 17:01:08 [auto1.es] INFO: Saving data for XP82584: {'auction_closing_time': 1769703560.0, 'created_time': 1768825974.127653, 'last_price_update_time': 1769619668.990404}
2026-01-28 17:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XP82584') HTTP/1.1" 204 0
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK67918> (referer: https://www.auto1.com/v1/car-details-view/ZK67918/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM59294> (referer: https://www.auto1.com/v1/car-details-view/UM59294/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA61855> (referer: https://www.auto1.com/v1/car-details-view/HA61855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TX26882> (referer: https://www.auto1.com/v1/car-details-view/TX26882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_e6e31ffdcce386beba9a4f971d405e70.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341a890>
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg saved to cache
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_548386fc53be29280ce6dbe8cf265951.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_82ee1accccbf9688aa024577d1e10aff.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_80f580ba6a6464245fa6d16dda3c7184.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f4ed312977558397ced5eed0eed1af8d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM59619> (referer: https://www.auto1.com/v1/car-details-view/AM59619/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM06663> (referer: https://www.auto1.com/v1/car-details-view/EM06663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with identifier: ZK67918
2026-01-28 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8, identifier: ZK67918
2026-01-28 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c7005d-874c-5f2a-bb54-143998e97aef with identifier: UM59294
2026-01-28 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c7005d-874c-5f2a-bb54-143998e97aef with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c7005d-874c-5f2a-bb54-143998e97aef with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2c7005d-874c-5f2a-bb54-143998e97aef, identifier: UM59294
2026-01-28 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34eff0d3-2944-597c-8b25-99588fb28374 with identifier: HA61855
2026-01-28 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34eff0d3-2944-597c-8b25-99588fb28374 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34eff0d3-2944-597c-8b25-99588fb28374 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34eff0d3-2944-597c-8b25-99588fb28374, identifier: HA61855
2026-01-28 17:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06dcad0-e7b7-51bd-a541-20c7f8376c72 with identifier: TX26882
2026-01-28 17:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06dcad0-e7b7-51bd-a541-20c7f8376c72 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06dcad0-e7b7-51bd-a541-20c7f8376c72 with scrape type 2
2026-01-28 17:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f06dcad0-e7b7-51bd-a541-20c7f8376c72, identifier: TX26882
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635db390>
2026-01-28 17:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_e6e31ffdcce386beba9a4f971d405e70.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_e6e31ffdcce386beba9a4f971d405e70.jpg saved to cache
2026-01-28 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634d0510>
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg saved to cache
2026-01-28 17:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with identifier: ZK67918
2026-01-28 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with identifier: ZK67918
2026-01-28 17:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9202a8dd-1511-5d0e-9fa2-a5d378caf2a8 with identifier: ZK67918 to the API
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZK67918>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:38:27Z',
 'fuel_type': 'diesel',
 'id': '9202a8dd-1511-5d0e-9fa2-a5d378caf2a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK67918',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 95683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZK67918%27 HTTP/1.1" 200 None
2026-01-28 17:01:10 [auto1.es] INFO: Saving data for ZK67918: {'auction_closing_time': 1769704707.0, 'created_time': 1769421891.082487, 'last_price_update_time': 1769619670.827955}
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZK67918') HTTP/1.1" 204 0
2026-01-28 17:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2c7005d-874c-5f2a-bb54-143998e97aef with identifier: UM59294
2026-01-28 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2c7005d-874c-5f2a-bb54-143998e97aef with identifier: UM59294
2026-01-28 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150656 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150656
2026-01-28 17:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b2c7005d-874c-5f2a-bb54-143998e97aef spider: auto1.es
2026-01-28 17:01:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b2c7005d-874c-5f2a-bb54-143998e97aef due to rule: high_mileage_for_country.json, error: 150656 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150656
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:48:45Z',
 'fuel_type': 'diesel',
 'id': 'b2c7005d-874c-5f2a-bb54-143998e97aef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM59294',
 'listing': 'auction',
 'location': 'ES, Montcada i Reixac',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 150656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.5 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2020}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UM59294%27 HTTP/1.1" 200 None
2026-01-28 17:01:11 [auto1.es] INFO: Saving data for UM59294: {'auction_closing_time': 1769705325.0, 'created_time': 1769518713.518555, 'last_price_update_time': 1769619671.0817}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UM59294') HTTP/1.1" 204 0
2026-01-28 17:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34eff0d3-2944-597c-8b25-99588fb28374 with identifier: HA61855
2026-01-28 17:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34eff0d3-2944-597c-8b25-99588fb28374 with identifier: HA61855
2026-01-28 17:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 34eff0d3-2944-597c-8b25-99588fb28374 with identifier: HA61855 to the API
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA61855>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:06:02Z',
 'fuel_type': 'petrol',
 'id': '34eff0d3-2944-597c-8b25-99588fb28374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA61855',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 28253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA61855%27 HTTP/1.1" 200 None
2026-01-28 17:01:11 [auto1.es] INFO: Saving data for HA61855: {'auction_closing_time': 1769702762.0, 'created_time': 1768220208.04067, 'last_price_update_time': 1769619671.379105}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA61855') HTTP/1.1" 204 0
2026-01-28 17:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f06dcad0-e7b7-51bd-a541-20c7f8376c72 with identifier: TX26882
2026-01-28 17:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f06dcad0-e7b7-51bd-a541-20c7f8376c72 with identifier: TX26882
2026-01-28 17:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f06dcad0-e7b7-51bd-a541-20c7f8376c72 with identifier: TX26882 to the API
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TX26882>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:20:12Z',
 'fuel_type': 'diesel',
 'id': 'f06dcad0-e7b7-51bd-a541-20c7f8376c72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX26882',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 74761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2019}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TX26882%27 HTTP/1.1" 200 None
2026-01-28 17:01:11 [auto1.es] INFO: Saving data for TX26882: {'auction_closing_time': 1769703612.0, 'created_time': 1769101801.258125, 'last_price_update_time': 1769619671.685504}
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TX26882') HTTP/1.1" 204 0
2026-01-28 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9b0137417a749c5f650864c463bfaa91.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT71551> (referer: https://www.auto1.com/v1/car-details-view/NT71551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM90018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e2a50>
2026-01-28 17:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_548386fc53be29280ce6dbe8cf265951.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_548386fc53be29280ce6dbe8cf265951.jpg saved to cache
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62987490>
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_82ee1accccbf9688aa024577d1e10aff.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_82ee1accccbf9688aa024577d1e10aff.jpg saved to cache
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62986ed0>
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_80f580ba6a6464245fa6d16dda3c7184.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_80f580ba6a6464245fa6d16dda3c7184.jpg saved to cache
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62995250>
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_f4ed312977558397ced5eed0eed1af8d.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f4ed312977558397ced5eed0eed1af8d.jpg saved to cache
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with identifier: AM59619
2026-01-28 17:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with scrape type 1
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_a828216c05533dfbabe7f21436e8f124.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a828216c05533dfbabe7f21436e8f124.jpg not downloaded yet
2026-01-28 17:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b258410-d5dd-506f-bea8-301080cee055 with identifier: EM06663
2026-01-28 17:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b258410-d5dd-506f-bea8-301080cee055 with scrape type 2
2026-01-28 17:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b258410-d5dd-506f-bea8-301080cee055 with scrape type 2
2026-01-28 17:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b258410-d5dd-506f-bea8-301080cee055, identifier: EM06663
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b258410-d5dd-506f-bea8-301080cee055 with identifier: EM06663
2026-01-28 17:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b258410-d5dd-506f-bea8-301080cee055 with identifier: EM06663
2026-01-28 17:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b258410-d5dd-506f-bea8-301080cee055 with identifier: EM06663 to the API
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM06663>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:42:34Z',
 'fuel_type': 'petrol',
 'id': '6b258410-d5dd-506f-bea8-301080cee055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM06663',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 45371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2019}
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM06663%27 HTTP/1.1" 200 None
2026-01-28 17:01:13 [auto1.es] INFO: Saving data for EM06663: {'auction_closing_time': 1769704954.0, 'created_time': 1769101399.069293, 'last_price_update_time': 1769619673.358088}
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM06663') HTTP/1.1" 204 0
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg not downloaded yet
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_466713d13f4418a4438056513bb81c59.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_5a886115ec72ab01af9a2873a9967db8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW38113> (referer: https://www.auto1.com/v1/car-details-view/JW38113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU03197> (referer: https://www.auto1.com/v1/car-details-view/PU03197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN20547> (referer: https://www.auto1.com/v1/car-details-view/NN20547/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC46230> (referer: https://www.auto1.com/v1/car-details-view/HC46230/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg not downloaded yet
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62934910>
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_9b0137417a749c5f650864c463bfaa91.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9b0137417a749c5f650864c463bfaa91.jpg saved to cache
2026-01-28 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184f3185-98d1-5da5-9bc6-9cb004462a28 with identifier: NT71551
2026-01-28 17:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184f3185-98d1-5da5-9bc6-9cb004462a28 with scrape type 2
2026-01-28 17:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184f3185-98d1-5da5-9bc6-9cb004462a28 with scrape type 2
2026-01-28 17:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 184f3185-98d1-5da5-9bc6-9cb004462a28, identifier: NT71551
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 184f3185-98d1-5da5-9bc6-9cb004462a28 with identifier: NT71551
2026-01-28 17:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 184f3185-98d1-5da5-9bc6-9cb004462a28 with identifier: NT71551
2026-01-28 17:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 184f3185-98d1-5da5-9bc6-9cb004462a28 with identifier: NT71551 to the API
2026-01-28 17:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NT71551>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:52:03Z',
 'fuel_type': 'petrol',
 'id': '184f3185-98d1-5da5-9bc6-9cb004462a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT71551',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 19511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'automatic',
 'trim': 'Stepway Comfort',
 'year': 2022}
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT71551%27 HTTP/1.1" 200 None
2026-01-28 17:01:14 [auto1.es] INFO: Saving data for NT71551: {'auction_closing_time': 1769705523.0, 'created_time': 1768975292.167543, 'last_price_update_time': 1769619674.148569}
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NT71551') HTTP/1.1" 204 0
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg not downloaded yet
2026-01-28 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_1107d6902f93b2e39fd9f898da280bcb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_a39758671721eb106164c8cfa4360c37.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY56775> (referer: https://www.auto1.com/v1/car-details-view/GY56775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62865210>
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg saved to cache
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62872510>
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg saved to cache
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62872fd0>
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_466713d13f4418a4438056513bb81c59.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_466713d13f4418a4438056513bb81c59.jpg saved to cache
2026-01-28 17:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628836d0>
2026-01-28 17:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_5a886115ec72ab01af9a2873a9967db8.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_5a886115ec72ab01af9a2873a9967db8.jpg saved to cache
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6286ff10>
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg saved to cache
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62876e50>
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg saved to cache
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba5eeed7-1239-5769-90b8-3740457cda17 with identifier: JW38113
2026-01-28 17:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba5eeed7-1239-5769-90b8-3740457cda17 with scrape type 2
2026-01-28 17:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba5eeed7-1239-5769-90b8-3740457cda17 with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ba5eeed7-1239-5769-90b8-3740457cda17, identifier: JW38113
2026-01-28 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb304120-682e-504b-b1e3-0949c44c6eaa with identifier: PU03197
2026-01-28 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb304120-682e-504b-b1e3-0949c44c6eaa with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb304120-682e-504b-b1e3-0949c44c6eaa with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb304120-682e-504b-b1e3-0949c44c6eaa, identifier: PU03197
2026-01-28 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a09fc82a-9e12-5aca-a04c-189c54633785 with identifier: NN20547
2026-01-28 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a09fc82a-9e12-5aca-a04c-189c54633785 with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a09fc82a-9e12-5aca-a04c-189c54633785 with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a09fc82a-9e12-5aca-a04c-189c54633785, identifier: NN20547
2026-01-28 17:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386569d7-0425-5328-8331-116362737a15 with identifier: HC46230
2026-01-28 17:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386569d7-0425-5328-8331-116362737a15 with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386569d7-0425-5328-8331-116362737a15 with scrape type 2
2026-01-28 17:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 386569d7-0425-5328-8331-116362737a15, identifier: HC46230
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_63fcb732b20eb63449097117c935de14.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_63fcb732b20eb63449097117c935de14.jpg not downloaded yet
2026-01-28 17:01:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY93343> (referer: https://www.auto1.com/v1/car-details-view/LY93343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ba5eeed7-1239-5769-90b8-3740457cda17 with identifier: JW38113
2026-01-28 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ba5eeed7-1239-5769-90b8-3740457cda17 with identifier: JW38113
2026-01-28 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152216 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152216
2026-01-28 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ba5eeed7-1239-5769-90b8-3740457cda17 spider: auto1.es
2026-01-28 17:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ba5eeed7-1239-5769-90b8-3740457cda17 due to rule: high_mileage_for_country.json, error: 152216 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152216
{'auction_title': '',
 'c_o_2_emission_value': 93,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:38:49Z',
 'fuel_type': 'diesel',
 'id': 'ba5eeed7-1239-5769-90b8-3740457cda17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW38113',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 152216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW38113%27 HTTP/1.1" 200 None
2026-01-28 17:01:16 [auto1.es] INFO: Saving data for JW38113: {'auction_closing_time': 1769704729.0, 'created_time': 1769421895.586571, 'last_price_update_time': 1769619676.633427}
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW38113') HTTP/1.1" 204 0
2026-01-28 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb304120-682e-504b-b1e3-0949c44c6eaa with identifier: PU03197
2026-01-28 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb304120-682e-504b-b1e3-0949c44c6eaa with identifier: PU03197
2026-01-28 17:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fb304120-682e-504b-b1e3-0949c44c6eaa with identifier: PU03197 to the API
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU03197>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:36:03Z',
 'fuel_type': 'petrol',
 'id': 'fb304120-682e-504b-b1e3-0949c44c6eaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU03197',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 59141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.5 TGDI Mild-Hybrid Drive',
 'transmission': 'automatic',
 'trim': 'Drive',
 'year': 2022}
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PU03197%27 HTTP/1.1" 200 None
2026-01-28 17:01:16 [auto1.es] INFO: Saving data for PU03197: {'auction_closing_time': 1769704563.0, 'created_time': 1769061823.151615, 'last_price_update_time': 1769619676.968207}
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PU03197') HTTP/1.1" 204 0
2026-01-28 17:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a09fc82a-9e12-5aca-a04c-189c54633785 with identifier: NN20547
2026-01-28 17:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a09fc82a-9e12-5aca-a04c-189c54633785 with identifier: NN20547
2026-01-28 17:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a09fc82a-9e12-5aca-a04c-189c54633785 with identifier: NN20547 to the API
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NN20547>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:24:12Z',
 'fuel_type': 'diesel',
 'id': 'a09fc82a-9e12-5aca-a04c-189c54633785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN20547',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 63567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 sDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2020}
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN20547%27 HTTP/1.1" 200 None
2026-01-28 17:01:17 [auto1.es] INFO: Saving data for NN20547: {'auction_closing_time': 1769703852.0, 'created_time': 1767780209.206966, 'last_price_update_time': 1769619677.289126}
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN20547') HTTP/1.1" 204 0
2026-01-28 17:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 386569d7-0425-5328-8331-116362737a15 with identifier: HC46230
2026-01-28 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 386569d7-0425-5328-8331-116362737a15 with identifier: HC46230
2026-01-28 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 386569d7-0425-5328-8331-116362737a15 spider: auto1.es
2026-01-28 17:01:17 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 386569d7-0425-5328-8331-116362737a15 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 99,
 'expiration_date': '2026-01-29T16:45:44Z',
 'fuel_type': 'diesel',
 'id': '386569d7-0425-5328-8331-116362737a15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC46230',
 'listing': 'auction',
 'location': 'Almería',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 92763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Aniversario Edition',
 'transmission': 'manual',
 'trim': '20 Aniversario Edition',
 'year': 2018}
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC46230%27 HTTP/1.1" 200 None
2026-01-28 17:01:17 [auto1.es] INFO: Saving data for HC46230: {'auction_closing_time': 1769705144.0, 'created_time': 1769421891.33583, 'last_price_update_time': 1769619677.508324}
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HC46230') HTTP/1.1" 204 0
2026-01-28 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a828216c05533dfbabe7f21436e8f124.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_5e4f2da9792ecfe324291d216d086449.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_5e4f2da9792ecfe324291d216d086449.jpg not downloaded yet
2026-01-28 17:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU20801> (referer: https://www.auto1.com/v1/car-details-view/DU20801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5c350>
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_1107d6902f93b2e39fd9f898da280bcb.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_1107d6902f93b2e39fd9f898da280bcb.jpg saved to cache
2026-01-28 17:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8f350>
2026-01-28 17:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F7c%252Fb57cc6734d8bf723fce2a3335f508a7d%252Fpa%252FSM01483_a39758671721eb106164c8cfa4360c37.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_a39758671721eb106164c8cfa4360c37.jpg saved to cache
2026-01-28 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ee87e64-3473-50c0-9f37-b4f34a75e238
2026-01-28 17:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0ee87e64-3473-50c0-9f37-b4f34a75e238, skipping ID generation
2026-01-28 17:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ee87e64-3473-50c0-9f37-b4f34a75e238 with scrape type 1
2026-01-28 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0ee87e64-3473-50c0-9f37-b4f34a75e238 from tracking dictionaries
2026-01-28 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0ee87e64-3473-50c0-9f37-b4f34a75e238 sending to next pipeline
2026-01-28 17:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ee87e64-3473-50c0-9f37-b4f34a75e238, identifier: SM01483
2026-01-28 17:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with identifier: GY56775
2026-01-28 17:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with scrape type 2
2026-01-28 17:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with scrape type 2
2026-01-28 17:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e3d94f5-9c52-5799-9c65-0f20e6c5825d, identifier: GY56775
2026-01-28 17:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ee87e64-3473-50c0-9f37-b4f34a75e238 with identifier: SM01483
2026-01-28 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ee87e64-3473-50c0-9f37-b4f34a75e238 with identifier: SM01483
2026-01-28 17:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ee87e64-3473-50c0-9f37-b4f34a75e238 with identifier: SM01483 to the API
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_a39758671721eb106164c8cfa4360c37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-01-29T16:39:09Z',
 'fuel_type': 'diesel',
 'id': '0ee87e64-3473-50c0-9f37-b4f34a75e238',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM01483',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Mazda',
 'model': '6',
 'odometer': 88333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_1107d6902f93b2e39fd9f898da280bcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_a39758671721eb106164c8cfa4360c37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f8b069f6e1b556e1fceb3690e6c6cc8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_aa5ddd9b317191fd02f4bd48c7b88635.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_5a886115ec72ab01af9a2873a9967db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_b5b1a3499a586ce1858bc9ba3542ff3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68588,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_466713d13f4418a4438056513bb81c59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_da4427f5bd1f44da9478a4c1ebfdb1a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9b0137417a749c5f650864c463bfaa91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_548386fc53be29280ce6dbe8cf265951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_82ee1accccbf9688aa024577d1e10aff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_f4ed312977558397ced5eed0eed1af8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_e6e31ffdcce386beba9a4f971d405e70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_fd9f9f794b36aba03b5f6d1303ef01fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_80f580ba6a6464245fa6d16dda3c7184.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0ee87e64-3473-50c0-9f37-b4f34a75e238/0ee87e64-3473-50c0-9f37-b4f34a75e238_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/7c/b57cc6734d8bf723fce2a3335f508a7d/pa/SM01483_9c9a8fce6ddbcb6028fa7cb6d260c649.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2018}
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM01483%27 HTTP/1.1" 200 None
2026-01-28 17:01:18 [auto1.es] INFO: Saving data for SM01483: {'created_time': 1769619678.731352, 'last_price_update_time': 1769619678.731363, 'auction_closing_time': 1769704749.0}
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM01483') HTTP/1.1" 204 0
2026-01-28 17:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with identifier: GY56775
2026-01-28 17:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with identifier: GY56775
2026-01-28 17:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5e3d94f5-9c52-5799-9c65-0f20e6c5825d with identifier: GY56775 to the API
2026-01-28 17:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GY56775>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 84,
 'expiration_date': '2026-01-29T16:25:17Z',
 'fuel_type': 'petrol',
 'id': '5e3d94f5-9c52-5799-9c65-0f20e6c5825d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY56775',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 22472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2021}
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY56775%27 HTTP/1.1" 200 None
2026-01-28 17:01:19 [auto1.es] INFO: Saving data for GY56775: {'auction_closing_time': 1769703917.0, 'created_time': 1768928671.636835, 'last_price_update_time': 1769619679.691037}
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY56775') HTTP/1.1" 204 0
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg not downloaded yet
2026-01-28 17:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with identifier: LY93343
2026-01-28 17:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with scrape type 2
2026-01-28 17:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with scrape type 2
2026-01-28 17:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4, identifier: LY93343
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC50335> (referer: https://www.auto1.com/v1/car-details-view/YC50335/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU61206> (referer: https://www.auto1.com/v1/car-details-view/SU61206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG23726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC76681> (referer: https://www.auto1.com/v1/car-details-view/GC76681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL84639/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with identifier: LY93343
2026-01-28 17:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with identifier: LY93343
2026-01-28 17:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73a09c49-94f5-5f8e-98ab-834eb5ed3fd4 with identifier: LY93343 to the API
2026-01-28 17:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LY93343>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:12:48Z',
 'fuel_type': 'diesel',
 'id': '73a09c49-94f5-5f8e-98ab-834eb5ed3fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY93343',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 115536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2018}
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY93343%27 HTTP/1.1" 200 None
2026-01-28 17:01:20 [auto1.es] INFO: Saving data for LY93343: {'auction_closing_time': 1769703168.0, 'created_time': 1768912917.837222, 'last_price_update_time': 1769619680.171767}
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LY93343') HTTP/1.1" 204 0
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg not downloaded yet
2026-01-28 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633e5810>
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_a828216c05533dfbabe7f21436e8f124.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a828216c05533dfbabe7f21436e8f124.jpg saved to cache
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with identifier: DU20801
2026-01-28 17:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with scrape type 2
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with scrape type 2
2026-01-28 17:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0728bc0e-564a-5e88-b3d2-15fc3d28b692, identifier: DU20801
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6363af90>
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_1c1217d05d1ea1b4c0576a605013b302.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg saved to cache
2026-01-28 17:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with identifier: DU20801
2026-01-28 17:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with identifier: DU20801
2026-01-28 17:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0728bc0e-564a-5e88-b3d2-15fc3d28b692 with identifier: DU20801 to the API
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DU20801>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:07:24Z',
 'fuel_type': 'petrol',
 'id': '0728bc0e-564a-5e88-b3d2-15fc3d28b692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU20801',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 77274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2021}
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU20801%27 HTTP/1.1" 200 None
2026-01-28 17:01:21 [auto1.es] INFO: Saving data for DU20801: {'auction_closing_time': 1769702844.0, 'created_time': 1769519305.331925, 'last_price_update_time': 1769619681.263717}
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DU20801') HTTP/1.1" 204 0
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_7922f8f4402c738f34576f1146bd7e4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_7922f8f4402c738f34576f1146bd7e4e.jpg not downloaded yet
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62812e50>
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg saved to cache
2026-01-28 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63468650>
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg saved to cache
2026-01-28 17:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6ef90>
2026-01-28 17:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg saved to cache
2026-01-28 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ecc426-94ec-56b1-9e81-68c427681242 with identifier: YC50335
2026-01-28 17:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ecc426-94ec-56b1-9e81-68c427681242 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ecc426-94ec-56b1-9e81-68c427681242 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14ecc426-94ec-56b1-9e81-68c427681242, identifier: YC50335
2026-01-28 17:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with identifier: SU61206
2026-01-28 17:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190, identifier: SU61206
2026-01-28 17:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with identifier: GC76681
2026-01-28 17:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with scrape type 2
2026-01-28 17:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cad36ce-fbe7-5552-a3fa-64c16131e0b4, identifier: GC76681
2026-01-28 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_5e4f2da9792ecfe324291d216d086449.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_63fcb732b20eb63449097117c935de14.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14ecc426-94ec-56b1-9e81-68c427681242 with identifier: YC50335
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-01-28 17:01:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14ecc426-94ec-56b1-9e81-68c427681242 with identifier: YC50335
2026-01-28 17:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14ecc426-94ec-56b1-9e81-68c427681242 with identifier: YC50335 to the API
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YC50335>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:30:33Z',
 'fuel_type': 'diesel',
 'id': '14ecc426-94ec-56b1-9e81-68c427681242',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC50335',
 'listing': 'auction',
 'location': 'ES, TARRAGONA',
 'make': 'BMW',
 'model': '1er',
 'odometer': 24130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-03-08',
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2025}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC50335%27 HTTP/1.1" 200 None
2026-01-28 17:01:23 [auto1.es] INFO: Saving data for YC50335: {'auction_closing_time': 1769704233.0, 'created_time': 1766585510.972536, 'last_price_update_time': 1769619683.100694}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC50335') HTTP/1.1" 204 0
2026-01-28 17:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with identifier: SU61206
2026-01-28 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with identifier: SU61206
2026-01-28 17:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2c1f290c-1feb-5c3c-acc6-8b1ad80c6190 with identifier: SU61206 to the API
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU61206>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:29:34Z',
 'fuel_type': 'diesel',
 'id': '2c1f290c-1feb-5c3c-acc6-8b1ad80c6190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU61206',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 133515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2019}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU61206%27 HTTP/1.1" 200 None
2026-01-28 17:01:23 [auto1.es] INFO: Saving data for SU61206: {'auction_closing_time': 1769704174.0, 'created_time': 1769002727.108014, 'last_price_update_time': 1769619683.455482}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU61206') HTTP/1.1" 204 0
2026-01-28 17:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with identifier: GC76681
2026-01-28 17:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with identifier: GC76681
2026-01-28 17:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5cad36ce-fbe7-5552-a3fa-64c16131e0b4 with identifier: GC76681 to the API
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GC76681>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:19:17Z',
 'fuel_type': 'petrol',
 'id': '5cad36ce-fbe7-5552-a3fa-64c16131e0b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC76681',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 53817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 25 TFSI Adrenalin',
 'transmission': 'manual',
 'trim': 'Adrenalin',
 'year': 2022}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC76681%27 HTTP/1.1" 200 None
2026-01-28 17:01:23 [auto1.es] INFO: Saving data for GC76681: {'auction_closing_time': 1769703557.0, 'created_time': 1769421648.799802, 'last_price_update_time': 1769619683.789559}
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GC76681') HTTP/1.1" 204 0
2026-01-28 17:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_693d94756421ede3809016c8508c1df2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_693d94756421ede3809016c8508c1df2.jpg not downloaded yet
2026-01-28 17:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63652890>
2026-01-28 17:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg saved to cache
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg not downloaded yet
2026-01-28 17:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62935910>
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_5e4f2da9792ecfe324291d216d086449.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_5e4f2da9792ecfe324291d216d086449.jpg saved to cache
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63655a10>
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_63fcb732b20eb63449097117c935de14.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_63fcb732b20eb63449097117c935de14.jpg saved to cache
2026-01-28 17:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629627d0>
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg saved to cache
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_d92212ad51968979831d8828c15fd25a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_d92212ad51968979831d8828c15fd25a.jpg not downloaded yet
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_4b2deb852891b89794d9a35955042051.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_4b2deb852891b89794d9a35955042051.jpg not downloaded yet
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP86933/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK59036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS86434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62810150>
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg saved to cache
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63470110>
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg saved to cache
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a33650>
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_049136f610145b3c05a021312f49c4ca.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg saved to cache
2026-01-28 17:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK95228> (referer: https://www.auto1.com/v1/car-details-view/UK95228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_693d94756421ede3809016c8508c1df2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_7922f8f4402c738f34576f1146bd7e4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM90018> (referer: https://www.auto1.com/v1/car-details-view/DM90018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62963190>
2026-01-28 17:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg saved to cache
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365e650>
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7a%252F73%252F7a738a5cdedbc129272890742fb5add4%252Fpa%252FKV73923_87f85446cd44406f52834e680433a08a.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg saved to cache
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2de44298-487d-5744-9937-ebe4151c540d
2026-01-28 17:01:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2de44298-487d-5744-9937-ebe4151c540d, skipping ID generation
2026-01-28 17:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de44298-487d-5744-9937-ebe4151c540d with scrape type 1
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2de44298-487d-5744-9937-ebe4151c540d from tracking dictionaries
2026-01-28 17:01:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2de44298-487d-5744-9937-ebe4151c540d sending to next pipeline
2026-01-28 17:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2de44298-487d-5744-9937-ebe4151c540d, identifier: KV73923
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633cdb10>
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg saved to cache
2026-01-28 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:27 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2de44298-487d-5744-9937-ebe4151c540d with identifier: KV73923
2026-01-28 17:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2de44298-487d-5744-9937-ebe4151c540d with identifier: KV73923
2026-01-28 17:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 59619, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv73923', 'expiration_date': '2026-01-29t16:31:16z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2de44298-487d-5744-9937-ebe4151c540d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 360824}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 123079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 167360}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 216991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 377424}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 127853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 301582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 164329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 49249}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82895}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 59619}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:31:16z',
     'fuel_type': 'petrol',
     'id': '2de44298-487d-5744-9937-ebe4151c540d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv73923',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 59619,
     'odometer_in_km': 59619,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 12,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 360824,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 123079,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167360,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72647,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216991,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 377424,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 127853,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301582,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71187,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 164329,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49249,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82895,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2023}
2026-01-28 17:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 2de44298-487d-5744-9937-ebe4151c540d spider: auto1.es
2026-01-28 17:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2de44298-487d-5744-9937-ebe4151c540d due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 59619, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv73923', 'expiration_date': '2026-01-29t16:31:16z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2de44298-487d-5744-9937-ebe4151c540d', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 360824}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 123079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 167360}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 216991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 377424}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 127853}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 301582}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71187}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 164329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 49249}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82895}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 59619}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:31:16z',
     'fuel_type': 'petrol',
     'id': '2de44298-487d-5744-9937-ebe4151c540d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kv73923',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 59619,
     'odometer_in_km': 59619,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 12,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 360824,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 123079,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 167360,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72647,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 216991,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 377424,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 127853,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 301582,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71187,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 164329,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 49249,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82895,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:31:16Z',
 'fuel_type': 'petrol',
 'id': '2de44298-487d-5744-9937-ebe4151c540d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV73923',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 59619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 360824,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_87f85446cd44406f52834e680433a08a.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_40be5ad944db7b2b0b75f6d0c1b79a19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 167360,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_3b07f6ae6bd467fca433a36246d134e1.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_0d0d9a05179cc751a5ccfb60bb54391b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 216991,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_049136f610145b3c05a021312f49c4ca.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 377424,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_6a14a04b5f44fda917c4f5317c9b4804.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_627a19589cb38e7ed708e948ed5e6ebb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 301582,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_d3e5d16d5a0a106c14f9b74e4e6ce477.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_c84636b1e8ba8a0255d7c8b03ac3be74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164329,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_1c1217d05d1ea1b4c0576a605013b302.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49249,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_85cf9609abfe713e89805495c152acfc.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de44298-487d-5744-9937-ebe4151c540d/2de44298-487d-5744-9937-ebe4151c540d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7a/73/7a738a5cdedbc129272890742fb5add4/pa/KV73923_06fe12a85a62d902b095ac3c8b294a4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2023}
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KV73923%27 HTTP/1.1" 200 None
2026-01-28 17:01:27 [auto1.es] INFO: Saving data for KV73923: {'created_time': 1769619687.2449, 'last_price_update_time': 1769619687.244913, 'auction_closing_time': 1769704276.0}
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KV73923') HTTP/1.1" 204 0
2026-01-28 17:01:27 [auto1.es] INFO: Found listing with ID: EH57940
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH57940%27 HTTP/1.1" 200 None
2026-01-28 17:01:27 [auto1.es] INFO: Scrape type for EH57940: 2
2026-01-28 17:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ49503> (referer: https://www.auto1.com/v1/car-details-view/NJ49503/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with identifier: UK95228
2026-01-28 17:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with scrape type 2
2026-01-28 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with scrape type 2
2026-01-28 17:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 97ef2de5-7e91-5bab-ba1c-3cc9c351302a, identifier: UK95228
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63468850>
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg saved to cache
2026-01-28 17:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62af63d0>
2026-01-28 17:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_693d94756421ede3809016c8508c1df2.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_693d94756421ede3809016c8508c1df2.jpg saved to cache
2026-01-28 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a3090>
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_7922f8f4402c738f34576f1146bd7e4e.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_7922f8f4402c738f34576f1146bd7e4e.jpg saved to cache
2026-01-28 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with identifier: DM90018
2026-01-28 17:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with scrape type 2
2026-01-28 17:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with scrape type 2
2026-01-28 17:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e, identifier: DM90018
2026-01-28 17:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_d92212ad51968979831d8828c15fd25a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:28 [auto1.es] INFO: Found listing with ID: YN30310
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN30310%27 HTTP/1.1" 200 None
2026-01-28 17:01:28 [auto1.es] INFO: Scrape type for YN30310: 2
2026-01-28 17:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with identifier: UK95228
2026-01-28 17:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with identifier: UK95228
2026-01-28 17:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 97ef2de5-7e91-5bab-ba1c-3cc9c351302a with identifier: UK95228 to the API
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK95228>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:38:13Z',
 'fuel_type': 'petrol',
 'id': '97ef2de5-7e91-5bab-ba1c-3cc9c351302a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK95228',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Fiat',
 'model': '500',
 'odometer': 60921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2021}
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK95228%27 HTTP/1.1" 200 None
2026-01-28 17:01:28 [auto1.es] INFO: Saving data for UK95228: {'auction_closing_time': 1769704693.0, 'created_time': 1768928667.611215, 'last_price_update_time': 1769619688.840822}
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UK95228') HTTP/1.1" 204 0
2026-01-28 17:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with identifier: DM90018
2026-01-28 17:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with identifier: DM90018
2026-01-28 17:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ce946bb-c3f2-58dd-83d9-eb1845e79d6e with identifier: DM90018 to the API
2026-01-28 17:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM90018>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:40:01Z',
 'fuel_type': 'petrol',
 'id': '1ce946bb-c3f2-58dd-83d9-eb1845e79d6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM90018',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 76827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM90018%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Saving data for DM90018: {'auction_closing_time': 1769704801.0, 'created_time': 1769518909.712408, 'last_price_update_time': 1769619689.151724}
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM90018') HTTP/1.1" 204 0
2026-01-28 17:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_4b2deb852891b89794d9a35955042051.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: NS64232
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS64232%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Scrape type for NS64232: 1
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: NX00377
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NX00377%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Scrape type for NX00377: 0
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: NM57420
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM57420%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Scrape type for NM57420: 0
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: VF55204
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF55204%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Scrape type for VF55204: 2
2026-01-28 17:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with identifier: NJ49503
2026-01-28 17:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with scrape type 2
2026-01-28 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with scrape type 2
2026-01-28 17:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5160ab6c-5d2f-5272-b281-2a2b0722a0bc, identifier: NJ49503
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62916850>
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_d92212ad51968979831d8828c15fd25a.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_d92212ad51968979831d8828c15fd25a.jpg saved to cache
2026-01-28 17:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with identifier: NJ49503
2026-01-28 17:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with identifier: NJ49503
2026-01-28 17:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5160ab6c-5d2f-5272-b281-2a2b0722a0bc with identifier: NJ49503 to the API
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NJ49503>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:57:50Z',
 'fuel_type': 'petrol',
 'id': '5160ab6c-5d2f-5272-b281-2a2b0722a0bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ49503',
 'listing': 'auction',
 'location': 'ES, San Sebastián de los Reyes, Madrid',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 13636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid Tecno 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno 2WD',
 'year': 2023}
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ49503%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Saving data for NJ49503: {'auction_closing_time': 1769705870.0, 'created_time': 1769518946.895666, 'last_price_update_time': 1769619689.927988}
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ49503') HTTP/1.1" 204 0
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: YR74795
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR74795%27 HTTP/1.1" 200 None
2026-01-28 17:01:29 [auto1.es] INFO: Scrape type for YR74795: 2
2026-01-28 17:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU12578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU73212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:29 [auto1.es] INFO: Found listing with ID: FG84665
2026-01-28 17:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG84665%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for FG84665: 1
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW64102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT01981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6c890>
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb8%252F94b801593781ab3800b4056faa2fc949%252Fpa%252FAM59619_4b2deb852891b89794d9a35955042051.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_4b2deb852891b89794d9a35955042051.jpg saved to cache
2026-01-28 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575
2026-01-28 17:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88f30c14-8406-5e4c-ba2f-b954bfdfa575, skipping ID generation
2026-01-28 17:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with scrape type 1
2026-01-28 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 88f30c14-8406-5e4c-ba2f-b954bfdfa575 from tracking dictionaries
2026-01-28 17:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88f30c14-8406-5e4c-ba2f-b954bfdfa575 sending to next pipeline
2026-01-28 17:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88f30c14-8406-5e4c-ba2f-b954bfdfa575, identifier: AM59619
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: NZ57832
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ57832%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for NZ57832: 2
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with identifier: AM59619
2026-01-28 17:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with identifier: AM59619
2026-01-28 17:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88f30c14-8406-5e4c-ba2f-b954bfdfa575 with identifier: AM59619 to the API
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_4b2deb852891b89794d9a35955042051.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:14:52Z',
 'fuel_type': 'petrol',
 'id': '88f30c14-8406-5e4c-ba2f-b954bfdfa575',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM59619',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 61530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a828216c05533dfbabe7f21436e8f124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 273885,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_9133f4b74b7a77fc2b0e2e85fa477fcb.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228410,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_82f8b178cb6999b9e02163ba420e3f6d.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_c0defabdc9db4de7cf4cbdc2edb89442.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_63fcb732b20eb63449097117c935de14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_5e4f2da9792ecfe324291d216d086449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154382,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_30d209aaa57a41eb39d219fc6c89d6d0.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_6b50cbad5119cf753f1188d57a18e8c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_7922f8f4402c738f34576f1146bd7e4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_693d94756421ede3809016c8508c1df2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_a2ca49c0f4e17dbf11ffb8700c71d777.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160259,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_d92212ad51968979831d8828c15fd25a.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88f30c14-8406-5e4c-ba2f-b954bfdfa575/88f30c14-8406-5e4c-ba2f-b954bfdfa575_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158520,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b8/94b801593781ab3800b4056faa2fc949/pa/AM59619_4b2deb852891b89794d9a35955042051.jpg',
             'Width': 2040}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo GS Line',
 'transmission': 'manual',
 'trim': 'GS Line',
 'year': 2023}
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM59619%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Saving data for AM59619: {'created_time': 1769619690.782405, 'last_price_update_time': 1769619690.782416, 'auction_closing_time': 1769703292.0}
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM59619') HTTP/1.1" 204 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: PX39170
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX39170%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for PX39170: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: XU57331
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU57331%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for XU57331: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: YY25226
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY25226%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for YY25226: 2
2026-01-28 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN74172> (referer: https://www.auto1.com/v1/car-details-view/YN74172/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG23726> (referer: https://www.auto1.com/v1/car-details-view/UG23726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: KS16688
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KS16688%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for KS16688: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: ZR58264
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR58264%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for ZR58264: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: AZ08882
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AZ08882%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for AZ08882: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: YE07750
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE07750%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for YE07750: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: JF24030
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JF24030%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for JF24030: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: WF73156
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF73156%27 HTTP/1.1" 200 None
2026-01-28 17:01:30 [auto1.es] INFO: Scrape type for WF73156: 0
2026-01-28 17:01:30 [auto1.es] INFO: Found listing with ID: BV39192
2026-01-28 17:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV39192%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for BV39192: 0
2026-01-28 17:01:31 [auto1.es] INFO: Found listing with ID: XC49329
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC49329%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for XC49329: 2
2026-01-28 17:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT03911> (referer: https://www.auto1.com/v1/car-details-view/UT03911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:31 [auto1.es] INFO: Found listing with ID: UN87696
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN87696%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for UN87696: 2
2026-01-28 17:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:31 [auto1.es] INFO: Found listing with ID: VH95267
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH95267%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for VH95267: 0
2026-01-28 17:01:31 [auto1.es] INFO: Found listing with ID: YD94145
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD94145%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for YD94145: 2
2026-01-28 17:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817a11aa-01f0-5435-8823-548744befbaf with identifier: YN74172
2026-01-28 17:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817a11aa-01f0-5435-8823-548744befbaf with scrape type 2
2026-01-28 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817a11aa-01f0-5435-8823-548744befbaf with scrape type 2
2026-01-28 17:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 817a11aa-01f0-5435-8823-548744befbaf, identifier: YN74172
2026-01-28 17:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with identifier: UG23726
2026-01-28 17:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with scrape type 1
2026-01-28 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5b7857d91073b5e6e71d846cee6151f6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5b7857d91073b5e6e71d846cee6151f6.jpg not downloaded yet
2026-01-28 17:01:31 [auto1.es] INFO: Found listing with ID: PX86419
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX86419%27 HTTP/1.1" 200 None
2026-01-28 17:01:31 [auto1.es] INFO: Scrape type for PX86419: 2
2026-01-28 17:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 817a11aa-01f0-5435-8823-548744befbaf with identifier: YN74172
2026-01-28 17:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 817a11aa-01f0-5435-8823-548744befbaf with identifier: YN74172
2026-01-28 17:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 817a11aa-01f0-5435-8823-548744befbaf with identifier: YN74172 to the API
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN74172>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:01:53Z',
 'fuel_type': 'petrol',
 'id': '817a11aa-01f0-5435-8823-548744befbaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN74172',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Fiat',
 'model': '500',
 'odometer': 36667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN74172%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Saving data for YN74172: {'auction_closing_time': 1769702513.0, 'created_time': 1765904458.340079, 'last_price_update_time': 1769619692.08083}
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN74172') HTTP/1.1" 204 0
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_cb533fa9198f9966d4694d023f808ab3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_cb533fa9198f9966d4694d023f808ab3.jpg not downloaded yet
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: MY67212
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY67212%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for MY67212: 0
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: KG36099
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG36099%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for KG36099: 0
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: PE29984
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE29984%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for PE29984: 0
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: DP66753
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP66753%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for DP66753: 0
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: GL75649
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL75649%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for GL75649: 1
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg not downloaded yet
2026-01-28 17:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL84639> (referer: https://www.auto1.com/v1/car-details-view/XL84639/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c with identifier: UT03911
2026-01-28 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c with scrape type 2
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c with scrape type 2
2026-01-28 17:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c, identifier: UT03911
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: KJ95887
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ95887%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for KJ95887: 2
2026-01-28 17:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c with identifier: UT03911
2026-01-28 17:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c with identifier: UT03911
2026-01-28 17:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 60982, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut03911', 'expiration_date': '2026-01-29t16:20:41z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, la roda de andalucía', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 151, 'id': '18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60982}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:41z',
     'fuel_type': 'petrol',
     'id': '18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut03911',
     'listing': 'auction',
     'location': 'es, la roda de andalucía',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 60982,
     'odometer_in_km': 60982,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2021}
2026-01-28 17:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c spider: auto1.es
2026-01-28 17:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 60982, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut03911', 'expiration_date': '2026-01-29t16:20:41z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, la roda de andalucía', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 151, 'id': '18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 60982}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': 151,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:20:41z',
     'fuel_type': 'petrol',
     'id': '18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ut03911',
     'listing': 'auction',
     'location': 'es, la roda de andalucía',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 60982,
     'odometer_in_km': 60982,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.2 puretech allure pack',
     'transmission': 'automatic',
     'trim': 'allure pack',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:41Z',
 'fuel_type': 'petrol',
 'id': '18dc3ef5-d2ce-52dc-b9e6-bab3f6afec2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT03911',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 60982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT03911%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Saving data for UT03911: {'auction_closing_time': 1769703641.0, 'created_time': 1769421814.331634, 'last_price_update_time': 1769619692.662739}
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT03911') HTTP/1.1" 204 0
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_9884531b409f6b987cdfc5aa987f738e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_9884531b409f6b987cdfc5aa987f738e.jpg not downloaded yet
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: AH55532
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH55532%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for AH55532: 2
2026-01-28 17:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS86434> (referer: https://www.auto1.com/v1/car-details-view/WS86434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK59036> (referer: https://www.auto1.com/v1/car-details-view/PK59036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694150a8-fc9f-5b61-8f90-8346db47bd35 with identifier: XL84639
2026-01-28 17:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694150a8-fc9f-5b61-8f90-8346db47bd35 with scrape type 1
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_b109d420a9b79d46c239cb17f85c7f11.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg not downloaded yet
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_10ea577fdf716d4ade945738239a22c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_10ea577fdf716d4ade945738239a22c5.jpg not downloaded yet
2026-01-28 17:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: GF40460
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF40460%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for GF40460: 0
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: LC75977
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC75977%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for LC75977: 1
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_18eaca7f6af3427707b907ddaedabb2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg not downloaded yet
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5126b6a3929638cef7992f3197987b98.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5126b6a3929638cef7992f3197987b98.jpg not downloaded yet
2026-01-28 17:01:32 [auto1.es] INFO: Found listing with ID: YM67211
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM67211%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [auto1.es] INFO: Scrape type for YM67211: 2
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_869bb7293f0bf79361022d7cea5176b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg not downloaded yet
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg not downloaded yet
2026-01-28 17:01:33 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25e2591f-01a1-51cf-a44b-f3cb435e397a with identifier: WS86434
2026-01-28 17:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25e2591f-01a1-51cf-a44b-f3cb435e397a with scrape type 2
2026-01-28 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25e2591f-01a1-51cf-a44b-f3cb435e397a with scrape type 2
2026-01-28 17:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25e2591f-01a1-51cf-a44b-f3cb435e397a, identifier: WS86434
2026-01-28 17:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37ffc41f-59eb-51a9-ac93-ab91eca43150 with identifier: PK59036
2026-01-28 17:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ffc41f-59eb-51a9-ac93-ab91eca43150 with scrape type 2
2026-01-28 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37ffc41f-59eb-51a9-ac93-ab91eca43150 with scrape type 2
2026-01-28 17:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 37ffc41f-59eb-51a9-ac93-ab91eca43150, identifier: PK59036
2026-01-28 17:01:33 [auto1.es] INFO: Found listing with ID: JE91492
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE91492%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [auto1.es] INFO: Scrape type for JE91492: 0
2026-01-28 17:01:33 [auto1.es] INFO: Found listing with ID: NV32850
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NV32850%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [auto1.es] INFO: Scrape type for NV32850: 0
2026-01-28 17:01:33 [auto1.es] INFO: Found listing with ID: ZL56858
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL56858%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [auto1.es] INFO: Scrape type for ZL56858: 1
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg not downloaded yet
2026-01-28 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25e2591f-01a1-51cf-a44b-f3cb435e397a with identifier: WS86434
2026-01-28 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25e2591f-01a1-51cf-a44b-f3cb435e397a with identifier: WS86434
2026-01-28 17:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 25e2591f-01a1-51cf-a44b-f3cb435e397a with identifier: WS86434 to the API
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%2725e2591f-01a1-51cf-a44b-f3cb435e397a%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 25e2591f-01a1-51cf-a44b-f3cb435e397a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:01:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS86434>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:46:43Z',
 'fuel_type': 'petrol',
 'id': '25e2591f-01a1-51cf-a44b-f3cb435e397a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS86434',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 59508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS86434%27 HTTP/1.1" 200 None
2026-01-28 17:01:33 [auto1.es] INFO: Saving data for WS86434: {'auction_closing_time': 1769705203.0, 'created_time': 1768842099.966888, 'last_price_update_time': 1769619693.655054}
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WS86434') HTTP/1.1" 204 0
2026-01-28 17:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 37ffc41f-59eb-51a9-ac93-ab91eca43150 with identifier: PK59036
2026-01-28 17:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 37ffc41f-59eb-51a9-ac93-ab91eca43150 with identifier: PK59036
2026-01-28 17:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 37ffc41f-59eb-51a9-ac93-ab91eca43150 with identifier: PK59036 to the API
2026-01-28 17:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PK59036>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:29:27Z',
 'fuel_type': 'petrol',
 'id': '37ffc41f-59eb-51a9-ac93-ab91eca43150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK59036',
 'listing': 'auction',
 'location': 'ES, Alicante',
 'make': 'BMW',
 'model': '2er',
 'odometer': 27862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK59036%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Saving data for PK59036: {'auction_closing_time': 1769704167.0, 'created_time': 1769518766.55972, 'last_price_update_time': 1769619694.563834}
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK59036') HTTP/1.1" 204 0
2026-01-28 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg not downloaded yet
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: VH21101
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VH21101%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for VH21101: 0
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: RB44600
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RB44600%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for RB44600: 0
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: SZ42428
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SZ42428%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for SZ42428: 0
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: PS02868
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS02868%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for PS02868: 0
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: UP41992
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP41992%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for UP41992: 2
2026-01-28 17:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_9884531b409f6b987cdfc5aa987f738e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: YN46395
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN46395%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for YN46395: 2
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_64ee57f74697da586be8c724486d44a4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg not downloaded yet
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5fe54f29e6985e778faee857989b7fb2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5fe54f29e6985e778faee857989b7fb2.jpg not downloaded yet
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: KU98013
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU98013%27 HTTP/1.1" 200 None
2026-01-28 17:01:34 [auto1.es] INFO: Scrape type for KU98013: 0
2026-01-28 17:01:34 [auto1.es] INFO: Found listing with ID: WS16949
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS16949%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for WS16949: 2
2026-01-28 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH57940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP86933> (referer: https://www.auto1.com/v1/car-details-view/FP86933/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN30310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS64232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: DN85233
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN85233%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for DN85233: 0
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: TP36756
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP36756%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for TP36756: 1
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_aa37c76e297ad72f4b61c3499a98d899.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg not downloaded yet
2026-01-28 17:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e20d0>
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_b109d420a9b79d46c239cb17f85c7f11.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg saved to cache
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg not downloaded yet
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: PS52157
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS52157%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for PS52157: 1
2026-01-28 17:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_063150f48db355214d6a90e74ed3ffa1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg not downloaded yet
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_702b37814197000a9aa4cb325ad0e84a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_702b37814197000a9aa4cb325ad0e84a.jpg not downloaded yet
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: MP48653
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP48653%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for MP48653: 0
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: CR90298
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CR90298%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for CR90298: 0
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: PF42386
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF42386%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for PF42386: 0
2026-01-28 17:01:35 [auto1.es] INFO: Found listing with ID: PZ78942
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ78942%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [auto1.es] INFO: Scrape type for PZ78942: 2
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6296d550>
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_9884531b409f6b987cdfc5aa987f738e.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_9884531b409f6b987cdfc5aa987f738e.jpg saved to cache
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with identifier: FP86933
2026-01-28 17:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with scrape type 2
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with scrape type 2
2026-01-28 17:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 580ef9f0-141b-5c51-bb1e-172d2e9fbf86, identifier: FP86933
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_986ee77047da129ae36c21b917c83f35.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg not downloaded yet
2026-01-28 17:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with identifier: FP86933
2026-01-28 17:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with identifier: FP86933
2026-01-28 17:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 580ef9f0-141b-5c51-bb1e-172d2e9fbf86 with identifier: FP86933 to the API
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FP86933>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:15:02Z',
 'fuel_type': 'hybrid',
 'id': '580ef9f0-141b-5c51-bb1e-172d2e9fbf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP86933',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 140255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid Active Tech',
 'transmission': 'automatic',
 'trim': 'Active Tech',
 'year': 2019}
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FP86933%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Saving data for FP86933: {'auction_closing_time': 1769703302.0, 'created_time': 1768473733.804685, 'last_price_update_time': 1769619696.231692}
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FP86933') HTTP/1.1" 204 0
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_f04db2e30779771697e39ca724ad5deb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_f04db2e30779771697e39ca724ad5deb.jpg not downloaded yet
2026-01-28 17:01:36 [auto1.es] INFO: Found listing with ID: KA69441
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA69441%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Scrape type for KA69441: 2
2026-01-28 17:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg not downloaded yet
2026-01-28 17:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF55204/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG84665/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR74795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ57832/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633cf210>
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg saved to cache
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_4acf85b4a48627f372728921941eacfe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_4acf85b4a48627f372728921941eacfe.jpg not downloaded yet
2026-01-28 17:01:36 [auto1.es] INFO: Found listing with ID: SC41958
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SC41958%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Scrape type for SC41958: 0
2026-01-28 17:01:36 [auto1.es] INFO: Found listing with ID: WH21616
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH21616%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Scrape type for WH21616: 0
2026-01-28 17:01:36 [auto1.es] INFO: Found listing with ID: YZ87320
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ87320%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Scrape type for YZ87320: 2
2026-01-28 17:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_62fa32b9bbe961821ed6861da526e98a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg not downloaded yet
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_0146b826257cfee361d1725bbcb93ce9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_0146b826257cfee361d1725bbcb93ce9.jpg not downloaded yet
2026-01-28 17:01:36 [auto1.es] INFO: Found listing with ID: ZV43271
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV43271%27 HTTP/1.1" 200 None
2026-01-28 17:01:36 [auto1.es] INFO: Scrape type for ZV43271: 2
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629b0890>
2026-01-28 17:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg saved to cache
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_2bc72f19c98085b0d268fa4d1487012c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg not downloaded yet
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_f04db2e30779771697e39ca724ad5deb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg not downloaded yet
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: DH75508
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75508%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for DH75508: 2
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg not downloaded yet
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU73212> (referer: https://www.auto1.com/v1/car-details-view/WU73212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW64102> (referer: https://www.auto1.com/v1/car-details-view/LW64102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_8464d3620e8614da9e4f1166424250d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_8464d3620e8614da9e4f1166424250d9.jpg not downloaded yet
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: TG43398
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG43398%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for TG43398: 2
2026-01-28 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_a59b9def04df52a814bf5a644d060b08.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg not downloaded yet
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: XB63829
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XB63829%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for XB63829: 0
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: UC75679
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC75679%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for UC75679: 2
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC49329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_96b3adf21e146a21aabddc21a8d07648.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg not downloaded yet
2026-01-28 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT01981> (referer: https://www.auto1.com/v1/car-details-view/WT01981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62966050>
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_f04db2e30779771697e39ca724ad5deb.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_f04db2e30779771697e39ca724ad5deb.jpg saved to cache
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: MU76690
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU76690%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for MU76690: 2
2026-01-28 17:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_f451702c4f07006bee649bc7233b3c22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg not downloaded yet
2026-01-28 17:01:37 [auto1.es] INFO: Found listing with ID: FC73601
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73601%27 HTTP/1.1" 200 None
2026-01-28 17:01:37 [auto1.es] INFO: Scrape type for FC73601: 2
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6a950>
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_986ee77047da129ae36c21b917c83f35.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg saved to cache
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd655694-ffd8-5ef2-a870-6cb752746fe7 with identifier: WU73212
2026-01-28 17:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd655694-ffd8-5ef2-a870-6cb752746fe7 with scrape type 2
2026-01-28 17:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd655694-ffd8-5ef2-a870-6cb752746fe7 with scrape type 2
2026-01-28 17:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd655694-ffd8-5ef2-a870-6cb752746fe7, identifier: WU73212
2026-01-28 17:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d097815c-6338-5390-abf4-abc91de16717 with identifier: LW64102
2026-01-28 17:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d097815c-6338-5390-abf4-abc91de16717 with scrape type 2
2026-01-28 17:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d097815c-6338-5390-abf4-abc91de16717 with scrape type 2
2026-01-28 17:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d097815c-6338-5390-abf4-abc91de16717, identifier: LW64102
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63409cd0>
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_2bc72f19c98085b0d268fa4d1487012c.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg saved to cache
2026-01-28 17:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bbe5e5-7075-53e6-9632-11e17f771152 with identifier: WT01981
2026-01-28 17:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bbe5e5-7075-53e6-9632-11e17f771152 with scrape type 2
2026-01-28 17:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bbe5e5-7075-53e6-9632-11e17f771152 with scrape type 2
2026-01-28 17:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 74bbe5e5-7075-53e6-9632-11e17f771152, identifier: WT01981
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_f48049c0a154407d3589cde080fa9f9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg not downloaded yet
2026-01-28 17:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd655694-ffd8-5ef2-a870-6cb752746fe7 with identifier: WU73212
2026-01-28 17:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd655694-ffd8-5ef2-a870-6cb752746fe7 with identifier: WU73212
2026-01-28 17:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151133 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151133
2026-01-28 17:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: cd655694-ffd8-5ef2-a870-6cb752746fe7 spider: auto1.es
2026-01-28 17:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cd655694-ffd8-5ef2-a870-6cb752746fe7 due to rule: high_mileage_for_country.json, error: 151133 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151133
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:34:57Z',
 'fuel_type': 'petrol',
 'id': 'cd655694-ffd8-5ef2-a870-6cb752746fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU73212',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 151133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-30',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU73212%27 HTTP/1.1" 200 None
2026-01-28 17:01:38 [auto1.es] INFO: Saving data for WU73212: {'auction_closing_time': 1769704497.0, 'created_time': 1768928728.257094, 'last_price_update_time': 1769619698.803236}
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU73212') HTTP/1.1" 204 0
2026-01-28 17:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d097815c-6338-5390-abf4-abc91de16717 with identifier: LW64102
2026-01-28 17:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d097815c-6338-5390-abf4-abc91de16717 with identifier: LW64102
2026-01-28 17:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d097815c-6338-5390-abf4-abc91de16717 with identifier: LW64102 to the API
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW64102>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:04:06Z',
 'fuel_type': 'petrol',
 'id': 'd097815c-6338-5390-abf4-abc91de16717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW64102',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 100566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW64102%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Saving data for LW64102: {'auction_closing_time': 1769702646.0, 'created_time': 1769003059.397892, 'last_price_update_time': 1769619699.244305}
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LW64102') HTTP/1.1" 204 0
2026-01-28 17:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 74bbe5e5-7075-53e6-9632-11e17f771152 with identifier: WT01981
2026-01-28 17:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 74bbe5e5-7075-53e6-9632-11e17f771152 with identifier: WT01981
2026-01-28 17:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 74bbe5e5-7075-53e6-9632-11e17f771152 with identifier: WT01981 to the API
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WT01981>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:39:25Z',
 'fuel_type': 'petrol',
 'id': '74bbe5e5-7075-53e6-9632-11e17f771152',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT01981',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 103052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 30 TFSI S Line',
 'transmission': 'manual',
 'trim': 'S Line',
 'year': 2019}
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT01981%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Saving data for WT01981: {'auction_closing_time': 1769704765.0, 'created_time': 1768912736.81811, 'last_price_update_time': 1769619699.54731}
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WT01981') HTTP/1.1" 204 0
2026-01-28 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: RN25115
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN25115%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for RN25115: 0
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: DS26733
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS26733%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for DS26733: 2
2026-01-28 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN46395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL75649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b695ffe90>
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg saved to cache
2026-01-28 17:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: FT06855
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT06855%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for FT06855: 2
2026-01-28 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: CN26718
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN26718%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for CN26718: 0
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: SH07171
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH07171%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for SH07171: 0
2026-01-28 17:01:39 [auto1.es] INFO: Found listing with ID: FX59239
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX59239%27 HTTP/1.1" 200 None
2026-01-28 17:01:39 [auto1.es] INFO: Scrape type for FX59239: 1
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6351c910>
2026-01-28 17:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_a59b9def04df52a814bf5a644d060b08.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg saved to cache
2026-01-28 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:40 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: BY66605
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BY66605%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for BY66605: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: TF16142
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF16142%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for TF16142: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: BZ30426
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BZ30426%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for BZ30426: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: PE50169
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE50169%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for PE50169: 2
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: BK93100
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK93100%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for BK93100: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: YE75668
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YE75668%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for YE75668: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: LL47969
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL47969%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for LL47969: 2
2026-01-28 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH55532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: VV48202
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48202%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for VV48202: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: NS33464
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS33464%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for NS33464: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: HS37774
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS37774%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for HS37774: 2
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: YK05158
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK05158%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for YK05158: 2
2026-01-28 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS52157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA69441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP41992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: MY29147
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY29147%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for MY29147: 2
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: BB75805
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB75805%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for BB75805: 2
2026-01-28 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: AH87062
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH87062%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for AH87062: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: GM59707
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM59707%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for GM59707: 2
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: JE81158
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JE81158%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for JE81158: 0
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: XR10719
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR10719%27 HTTP/1.1" 200 None
2026-01-28 17:01:40 [auto1.es] INFO: Scrape type for XR10719: 2
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a4d10>
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_f48049c0a154407d3589cde080fa9f9b.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg saved to cache
2026-01-28 17:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:40 [auto1.es] INFO: Found listing with ID: DC86019
2026-01-28 17:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DC86019%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for DC86019: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: WU22909
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU22909%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for WU22909: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: CP16982
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for CP16982: 2
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: AW48734
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW48734%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for AW48734: 2
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS64232> (referer: https://www.auto1.com/v1/car-details-view/NS64232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: DH46194
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH46194%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for DH46194: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: KP13931
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP13931%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for KP13931: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: WK51588
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK51588%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for WK51588: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: KM22208
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KM22208%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for KM22208: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: BK91545
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK91545%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for BK91545: 2
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: HT92350
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT92350%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for HT92350: 2
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: SL57759
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL57759%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for SL57759: 2
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: PA80546
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA80546%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for PA80546: 1
2026-01-28 17:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93599d54-edcf-5cc2-862b-34cad24d20ad with identifier: NS64232
2026-01-28 17:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93599d54-edcf-5cc2-862b-34cad24d20ad with scrape type 1
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg not downloaded yet
2026-01-28 17:01:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a024d0>
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_64ee57f74697da586be8c724486d44a4.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg saved to cache
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: XZ38594
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ38594%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for XZ38594: 2
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_e3d314764df8d65b8f742f672c57d542.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_e3d314764df8d65b8f742f672c57d542.jpg not downloaded yet
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: MK17684
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK17684%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for MK17684: 1
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS26733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN30310> (referer: https://www.auto1.com/v1/car-details-view/YN30310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg not downloaded yet
2026-01-28 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: XR27466
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR27466%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for XR27466: 2
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg not downloaded yet
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: LL06735
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL06735%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for LL06735: 0
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: CG01889
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG01889%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for CG01889: 2
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b2008b940f78b9fad32bbb555f020f22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b2008b940f78b9fad32bbb555f020f22.jpg not downloaded yet
2026-01-28 17:01:41 [auto1.es] INFO: Found listing with ID: SG66312
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG66312%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [auto1.es] INFO: Scrape type for SG66312: 1
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg not downloaded yet
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC75679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ57832> (referer: https://www.auto1.com/v1/car-details-view/NZ57832/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7aad20-3a06-5885-9c97-7e3c8359ce7f with identifier: YN30310
2026-01-28 17:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7aad20-3a06-5885-9c97-7e3c8359ce7f with scrape type 2
2026-01-28 17:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7aad20-3a06-5885-9c97-7e3c8359ce7f with scrape type 2
2026-01-28 17:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc7aad20-3a06-5885-9c97-7e3c8359ce7f, identifier: YN30310
2026-01-28 17:01:42 [auto1.es] INFO: Found listing with ID: SA43720
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA43720%27 HTTP/1.1" 200 None
2026-01-28 17:01:42 [auto1.es] INFO: Scrape type for SA43720: 2
2026-01-28 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc7aad20-3a06-5885-9c97-7e3c8359ce7f with identifier: YN30310
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-01-28 17:01:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc7aad20-3a06-5885-9c97-7e3c8359ce7f with identifier: YN30310
2026-01-28 17:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc7aad20-3a06-5885-9c97-7e3c8359ce7f with identifier: YN30310 to the API
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN30310>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:30:32Z',
 'fuel_type': 'electro',
 'id': 'dc7aad20-3a06-5885-9c97-7e3c8359ce7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN30310',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 14263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 100 kW Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2021}
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN30310%27 HTTP/1.1" 200 None
2026-01-28 17:01:42 [auto1.es] INFO: Saving data for YN30310: {'auction_closing_time': 1769704232.0, 'created_time': 1769519007.29879, 'last_price_update_time': 1769619702.680543}
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN30310') HTTP/1.1" 204 0
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_f4de21735475db27f255fbeabba5872d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_f4de21735475db27f255fbeabba5872d.jpg not downloaded yet
2026-01-28 17:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_e3d314764df8d65b8f742f672c57d542.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:43 [auto1.es] INFO: Found listing with ID: SB80679
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB80679%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [auto1.es] INFO: Scrape type for SB80679: 2
2026-01-28 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG43398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU76690/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b249a6aa72b63029322d5c986632915c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b249a6aa72b63029322d5c986632915c.jpg not downloaded yet
2026-01-28 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH75508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC49329> (referer: https://www.auto1.com/v1/car-details-view/XC49329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:43 [auto1.es] INFO: Found listing with ID: SG18347
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG18347%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [auto1.es] INFO: Scrape type for SG18347: 1
2026-01-28 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 802bca8c-b44e-5dbe-b85e-e21cfc679473 with identifier: NZ57832
2026-01-28 17:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 802bca8c-b44e-5dbe-b85e-e21cfc679473 with scrape type 2
2026-01-28 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 802bca8c-b44e-5dbe-b85e-e21cfc679473 with scrape type 2
2026-01-28 17:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 802bca8c-b44e-5dbe-b85e-e21cfc679473, identifier: NZ57832
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_4a48afc2fca49407c9302ac56a61efb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_4a48afc2fca49407c9302ac56a61efb0.jpg not downloaded yet
2026-01-28 17:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 802bca8c-b44e-5dbe-b85e-e21cfc679473 with identifier: NZ57832
2026-01-28 17:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 802bca8c-b44e-5dbe-b85e-e21cfc679473 with identifier: NZ57832
2026-01-28 17:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 802bca8c-b44e-5dbe-b85e-e21cfc679473 with identifier: NZ57832 to the API
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ57832>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:55:06Z',
 'fuel_type': 'hybrid',
 'id': '802bca8c-b44e-5dbe-b85e-e21cfc679473',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ57832',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'BMW',
 'model': '2er',
 'odometer': 101898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 225xe Active Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ57832%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [auto1.es] INFO: Saving data for NZ57832: {'auction_closing_time': 1769705706.0, 'created_time': 1769421752.148973, 'last_price_update_time': 1769619703.743786}
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ57832') HTTP/1.1" 204 0
2026-01-28 17:01:43 [auto1.es] INFO: Found listing with ID: DF95079
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95079%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [auto1.es] INFO: Scrape type for DF95079: 0
2026-01-28 17:01:43 [auto1.es] INFO: Found listing with ID: AT07824
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT07824%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [auto1.es] INFO: Scrape type for AT07824: 2
2026-01-28 17:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg not downloaded yet
2026-01-28 17:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62838490>
2026-01-28 17:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_e3d314764df8d65b8f742f672c57d542.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_e3d314764df8d65b8f742f672c57d542.jpg saved to cache
2026-01-28 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b321c228-577a-5685-ba10-e81b939ffdb1 with identifier: XC49329
2026-01-28 17:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b321c228-577a-5685-ba10-e81b939ffdb1 with scrape type 2
2026-01-28 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b321c228-577a-5685-ba10-e81b939ffdb1 with scrape type 2
2026-01-28 17:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b321c228-577a-5685-ba10-e81b939ffdb1, identifier: XC49329
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: AR93411
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR93411%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for AR93411: 0
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: YG04204
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG04204%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for YG04204: 0
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: WV71911
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV71911%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for WV71911: 0
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: VM33261
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM33261%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for VM33261: 0
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: KE41233
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE41233%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for KE41233: 2
2026-01-28 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b321c228-577a-5685-ba10-e81b939ffdb1 with identifier: XC49329
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-01-28 17:01:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b321c228-577a-5685-ba10-e81b939ffdb1 with identifier: XC49329
2026-01-28 17:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b321c228-577a-5685-ba10-e81b939ffdb1 with identifier: XC49329 to the API
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC49329>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': 'Rental',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:38:03Z',
 'fuel_type': 'petrol',
 'id': 'b321c228-577a-5685-ba10-e81b939ffdb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC49329',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Opel',
 'model': 'Cascada',
 'odometer': 72493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Cascada 1.4 Turbo Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2017}
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC49329%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Saving data for XC49329: {'auction_closing_time': 1769704683.0, 'created_time': 1767114346.294977, 'last_price_update_time': 1769619704.773173}
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC49329') HTTP/1.1" 204 0
2026-01-28 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b2008b940f78b9fad32bbb555f020f22.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_8c44ddece04b98bae6972d12e48cec93.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8c44ddece04b98bae6972d12e48cec93.jpg not downloaded yet
2026-01-28 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_f4de21735475db27f255fbeabba5872d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:44 [auto1.es] INFO: Found listing with ID: TV27917
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV27917%27 HTTP/1.1" 200 None
2026-01-28 17:01:44 [auto1.es] INFO: Scrape type for TV27917: 2
2026-01-28 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL47969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK05158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5ce90>
2026-01-28 17:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg saved to cache
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0cad3e166a284cab47590dc8703e1216.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0cad3e166a284cab47590dc8703e1216.jpg not downloaded yet
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [auto1.es] INFO: Found listing with ID: EF24544
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF24544%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [auto1.es] INFO: Scrape type for EF24544: 0
2026-01-28 17:01:45 [auto1.es] INFO: Found listing with ID: XY39863
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XY39863%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [auto1.es] INFO: Scrape type for XY39863: 0
2026-01-28 17:01:45 [auto1.es] INFO: Found listing with ID: EW64430
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW64430%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [auto1.es] INFO: Scrape type for EW64430: 1
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC73601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_4a48afc2fca49407c9302ac56a61efb0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_98cbd3f76013c72270774d8e1c2c764a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_98cbd3f76013c72270774d8e1c2c764a.jpg not downloaded yet
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL75649> (referer: https://www.auto1.com/v1/car-details-view/GL75649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:45 [auto1.es] INFO: Found listing with ID: AJ93542
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93542%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [auto1.es] INFO: Scrape type for AJ93542: 2
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63363d10>
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b2008b940f78b9fad32bbb555f020f22.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b2008b940f78b9fad32bbb555f020f22.jpg saved to cache
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629efc50>
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_f4de21735475db27f255fbeabba5872d.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_f4de21735475db27f255fbeabba5872d.jpg saved to cache
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_01c98be91059e41740f557680c68b69b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_01c98be91059e41740f557680c68b69b.jpg not downloaded yet
2026-01-28 17:01:45 [auto1.es] INFO: Found listing with ID: JA12453
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA12453%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [auto1.es] INFO: Scrape type for JA12453: 1
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8c44ddece04b98bae6972d12e48cec93.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0a7e51a4a083670601b457accf350315.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0a7e51a4a083670601b457accf350315.jpg not downloaded yet
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PE50169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS37774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635012d0>
2026-01-28 17:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_4a48afc2fca49407c9302ac56a61efb0.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_4a48afc2fca49407c9302ac56a61efb0.jpg saved to cache
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a with identifier: GL75649
2026-01-28 17:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7febcbd-7bed-5dc4-b97a-bd002ec87b8a with scrape type 1
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item d7febcbd-7bed-5dc4-b97a-bd002ec87b8a
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_e91a0d4af45d0fe051a97358b8ed67de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_e91a0d4af45d0fe051a97358b8ed67de.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_b01c30586a5cdb9627312324d28db03a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b01c30586a5cdb9627312324d28db03a.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_230cf8c24a8b3c8dd6d03131941c4a76.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_230cf8c24a8b3c8dd6d03131941c4a76.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_14590a94d70a614df8ac5a7438118107.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_14590a94d70a614df8ac5a7438118107.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_4fa0938ddfedf244748fe9454b0a3d3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_4fa0938ddfedf244748fe9454b0a3d3a.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_d1be004ff5a4b620701d9f307ec0b257.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_d1be004ff5a4b620701d9f307ec0b257.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_35705e684f84b6c79a7ec190eeaedf54.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_35705e684f84b6c79a7ec190eeaedf54.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_1cdd299cb73a2af5e87dac8220768667.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_1cdd299cb73a2af5e87dac8220768667.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_9cf39f1d0072fa6f1a16e61c85785fe3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_9cf39f1d0072fa6f1a16e61c85785fe3.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_b17ee8ac5491908d4cb98efec6d2f38f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b17ee8ac5491908d4cb98efec6d2f38f.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_884a4dfe158fb23e5eaa5c58103f48c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_884a4dfe158fb23e5eaa5c58103f48c1.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_8ced929d2b94cac380d4df5e97c2fc8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_8ced929d2b94cac380d4df5e97c2fc8c.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_22d7778684f8545d50369046981639d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_22d7778684f8545d50369046981639d8.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_a8628928db126d3250bda50107d86e5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_a8628928db126d3250bda50107d86e5d.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_0f2492f737e9e325c7017cbd380414c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_0f2492f737e9e325c7017cbd380414c5.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_338e9582c7320794e76e76f442328cdb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_338e9582c7320794e76e76f442328cdb.jpg already downloaded
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F3e%252F763e9b3b9274b75239a5638ee4ad09bf%252Fpa%252FGL75649_bbc7590f47be4edcfe0e4e01593848cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_bbc7590f47be4edcfe0e4e01593848cf.jpg already downloaded
2026-01-28 17:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a, identifier: GL75649
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_1256779ba8cb229cff0d4de167775e8a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_1256779ba8cb229cff0d4de167775e8a.jpg not downloaded yet
2026-01-28 17:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a with identifier: GL75649
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-01-28 17:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a with identifier: GL75649
2026-01-28 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169997 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169997
2026-01-28 17:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a spider: auto1.es
2026-01-28 17:01:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d7febcbd-7bed-5dc4-b97a-bd002ec87b8a due to rule: high_mileage_for_country.json, error: 169997 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169997
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:40:57Z',
 'fuel_type': 'diesel',
 'id': 'd7febcbd-7bed-5dc4-b97a-bd002ec87b8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL75649',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 169997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_e91a0d4af45d0fe051a97358b8ed67de.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b01c30586a5cdb9627312324d28db03a.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_230cf8c24a8b3c8dd6d03131941c4a76.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_14590a94d70a614df8ac5a7438118107.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_4fa0938ddfedf244748fe9454b0a3d3a.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_d1be004ff5a4b620701d9f307ec0b257.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_35705e684f84b6c79a7ec190eeaedf54.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_1cdd299cb73a2af5e87dac8220768667.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_9cf39f1d0072fa6f1a16e61c85785fe3.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b17ee8ac5491908d4cb98efec6d2f38f.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_884a4dfe158fb23e5eaa5c58103f48c1.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_8ced929d2b94cac380d4df5e97c2fc8c.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_22d7778684f8545d50369046981639d8.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_a8628928db126d3250bda50107d86e5d.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_0f2492f737e9e325c7017cbd380414c5.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_338e9582c7320794e76e76f442328cdb.jpg',
                'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_bbc7590f47be4edcfe0e4e01593848cf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_e91a0d4af45d0fe051a97358b8ed67de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b01c30586a5cdb9627312324d28db03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_230cf8c24a8b3c8dd6d03131941c4a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_14590a94d70a614df8ac5a7438118107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_4fa0938ddfedf244748fe9454b0a3d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_d1be004ff5a4b620701d9f307ec0b257.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_35705e684f84b6c79a7ec190eeaedf54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_1cdd299cb73a2af5e87dac8220768667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_9cf39f1d0072fa6f1a16e61c85785fe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_b17ee8ac5491908d4cb98efec6d2f38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_884a4dfe158fb23e5eaa5c58103f48c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_8ced929d2b94cac380d4df5e97c2fc8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_22d7778684f8545d50369046981639d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_a8628928db126d3250bda50107d86e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_0f2492f737e9e325c7017cbd380414c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_338e9582c7320794e76e76f442328cdb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7febcbd-7bed-5dc4-b97a-bd002ec87b8a/d7febcbd-7bed-5dc4-b97a-bd002ec87b8a_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/3e/763e9b3b9274b75239a5638ee4ad09bf/pa/GL75649_bbc7590f47be4edcfe0e4e01593848cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-04',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Lounge Business BMT/Start-Stopp',
 'transmission': 'automatic',
 'trim': 'Lounge Business BMT/Start-Stopp',
 'year': 2020}
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL75649%27 HTTP/1.1" 200 None
2026-01-28 17:01:47 [auto1.es] INFO: Saving data for GL75649: {'created_time': 1769619707.029205, 'last_price_update_time': 1769619707.029216, 'auction_closing_time': 1769704857.0}
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GL75649') HTTP/1.1" 204 0
2026-01-28 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0cad3e166a284cab47590dc8703e1216.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP41992> (referer: https://www.auto1.com/v1/car-details-view/UP41992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA69441> (referer: https://www.auto1.com/v1/car-details-view/KA69441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63645fd0>
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_8c44ddece04b98bae6972d12e48cec93.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8c44ddece04b98bae6972d12e48cec93.jpg saved to cache
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634799d0>
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0cad3e166a284cab47590dc8703e1216.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0cad3e166a284cab47590dc8703e1216.jpg saved to cache
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a87847e-e332-5a08-917d-d0e022671518 with identifier: UP41992
2026-01-28 17:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a87847e-e332-5a08-917d-d0e022671518 with scrape type 2
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a87847e-e332-5a08-917d-d0e022671518 with scrape type 2
2026-01-28 17:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0a87847e-e332-5a08-917d-d0e022671518, identifier: UP41992
2026-01-28 17:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with identifier: KA69441
2026-01-28 17:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with scrape type 2
2026-01-28 17:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with scrape type 2
2026-01-28 17:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cdff3586-2aab-51d6-9a3e-bdf0c3f78eab, identifier: KA69441
2026-01-28 17:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0a87847e-e332-5a08-917d-d0e022671518 with identifier: UP41992
2026-01-28 17:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0a87847e-e332-5a08-917d-d0e022671518 with identifier: UP41992
2026-01-28 17:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0a87847e-e332-5a08-917d-d0e022671518 with identifier: UP41992 to the API
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP41992>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:30:55Z',
 'fuel_type': 'diesel',
 'id': '0a87847e-e332-5a08-917d-d0e022671518',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP41992',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 106302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 1.6 CDTI Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2017}
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP41992%27 HTTP/1.1" 200 None
2026-01-28 17:01:48 [auto1.es] INFO: Saving data for UP41992: {'auction_closing_time': 1769704255.0, 'created_time': 1769002854.64677, 'last_price_update_time': 1769619708.270987}
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP41992') HTTP/1.1" 204 0
2026-01-28 17:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with identifier: KA69441
2026-01-28 17:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with identifier: KA69441
2026-01-28 17:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cdff3586-2aab-51d6-9a3e-bdf0c3f78eab with identifier: KA69441 to the API
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KA69441>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:59:00Z',
 'fuel_type': 'diesel',
 'id': 'cdff3586-2aab-51d6-9a3e-bdf0c3f78eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA69441',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 144716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.6 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2019}
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KA69441%27 HTTP/1.1" 200 None
2026-01-28 17:01:48 [auto1.es] INFO: Saving data for KA69441: {'auction_closing_time': 1769705940.0, 'created_time': 1769002734.004682, 'last_price_update_time': 1769619708.572047}
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KA69441') HTTP/1.1" 204 0
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0a7e51a4a083670601b457accf350315.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_1256779ba8cb229cff0d4de167775e8a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG66312/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH75508> (referer: https://www.auto1.com/v1/car-details-view/DH75508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK17684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB80679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA43720/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS26733> (referer: https://www.auto1.com/v1/car-details-view/DS26733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_01c98be91059e41740f557680c68b69b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63525d90>
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_0a7e51a4a083670601b457accf350315.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0a7e51a4a083670601b457accf350315.jpg saved to cache
2026-01-28 17:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_98cbd3f76013c72270774d8e1c2c764a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a63410>
2026-01-28 17:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_1256779ba8cb229cff0d4de167775e8a.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_1256779ba8cb229cff0d4de167775e8a.jpg saved to cache
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1a245df-dfd0-5077-b559-e3fbdbedc3b9 with identifier: DH75508
2026-01-28 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1a245df-dfd0-5077-b559-e3fbdbedc3b9 with scrape type 2
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1a245df-dfd0-5077-b559-e3fbdbedc3b9 with scrape type 2
2026-01-28 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c1a245df-dfd0-5077-b559-e3fbdbedc3b9, identifier: DH75508
2026-01-28 17:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4f25988-ab95-594b-8a65-ad1989a43756 with identifier: DS26733
2026-01-28 17:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4f25988-ab95-594b-8a65-ad1989a43756 with scrape type 2
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4f25988-ab95-594b-8a65-ad1989a43756 with scrape type 2
2026-01-28 17:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4f25988-ab95-594b-8a65-ad1989a43756, identifier: DS26733
2026-01-28 17:01:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f6810>
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_01c98be91059e41740f557680c68b69b.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_01c98be91059e41740f557680c68b69b.jpg saved to cache
2026-01-28 17:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c1a245df-dfd0-5077-b559-e3fbdbedc3b9 with identifier: DH75508
2026-01-28 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c1a245df-dfd0-5077-b559-e3fbdbedc3b9 with identifier: DH75508
2026-01-28 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 23463, 'odometer_reading_unit': 'km', 'registration_date': '2024-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dh75508', 'expiration_date': '2026-01-29t16:44:47z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'c1a245df-dfd0-5077-b559-e3fbdbedc3b9', 'current_year_diff': 2, 'age_in_months': 22, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 23463}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 22,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:44:47z',
     'fuel_type': 'petrol',
     'id': 'c1a245df-dfd0-5077-b559-e3fbdbedc3b9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dh75508',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 23463,
     'odometer_in_km': 23463,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-03-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2024}
2026-01-28 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c1a245df-dfd0-5077-b559-e3fbdbedc3b9 spider: auto1.es
2026-01-28 17:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c1a245df-dfd0-5077-b559-e3fbdbedc3b9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech allure pack', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'manual', 'odometer': 23463, 'odometer_reading_unit': 'km', 'registration_date': '2024-03-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dh75508', 'expiration_date': '2026-01-29t16:44:47z', 'origin_country_code': 'es', 'trim': 'allure pack', 'year': 2024, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 138, 'id': 'c1a245df-dfd0-5077-b559-e3fbdbedc3b9', 'current_year_diff': 2, 'age_in_months': 22, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 23463}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 22,
     'auction_title': '',
     'c_o_2_emission_value': 138,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 2,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:44:47z',
     'fuel_type': 'petrol',
     'id': 'c1a245df-dfd0-5077-b559-e3fbdbedc3b9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dh75508',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 23463,
     'odometer_in_km': 23463,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2024-03-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech allure pack',
     'transmission': 'manual',
     'trim': 'allure pack',
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:44:47Z',
 'fuel_type': 'petrol',
 'id': 'c1a245df-dfd0-5077-b559-e3fbdbedc3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH75508',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 23463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2024}
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75508%27 HTTP/1.1" 200 None
2026-01-28 17:01:49 [auto1.es] INFO: Saving data for DH75508: {'auction_closing_time': 1769705087.0, 'created_time': 1769519632.852152, 'last_price_update_time': 1769619709.912417}
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH75508') HTTP/1.1" 204 0
2026-01-28 17:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4f25988-ab95-594b-8a65-ad1989a43756 with identifier: DS26733
2026-01-28 17:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4f25988-ab95-594b-8a65-ad1989a43756 with identifier: DS26733
2026-01-28 17:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176711 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176711
2026-01-28 17:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d4f25988-ab95-594b-8a65-ad1989a43756 spider: auto1.es
2026-01-28 17:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d4f25988-ab95-594b-8a65-ad1989a43756 due to rule: high_mileage_for_country.json, error: 176711 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176711
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 117,
 'expiration_date': '2026-01-29T16:06:25Z',
 'fuel_type': 'petrol',
 'id': 'd4f25988-ab95-594b-8a65-ad1989a43756',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS26733',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 176711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.6 N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2018}
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS26733%27 HTTP/1.1" 200 None
2026-01-28 17:01:50 [auto1.es] INFO: Saving data for DS26733: {'auction_closing_time': 1769702785.0, 'created_time': 1769014924.246889, 'last_price_update_time': 1769619710.175875}
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS26733') HTTP/1.1" 204 0
2026-01-28 17:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b249a6aa72b63029322d5c986632915c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV27917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KE41233/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63369ed0>
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_98cbd3f76013c72270774d8e1c2c764a.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_98cbd3f76013c72270774d8e1c2c764a.jpg saved to cache
2026-01-28 17:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633c0e10>
2026-01-28 17:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg saved to cache
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA12453/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK05158> (referer: https://www.auto1.com/v1/car-details-view/YK05158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC73601> (referer: https://www.auto1.com/v1/car-details-view/FC73601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS37774> (referer: https://www.auto1.com/v1/car-details-view/HS37774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU76690> (referer: https://www.auto1.com/v1/car-details-view/MU76690/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629cc910>
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b249a6aa72b63029322d5c986632915c.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b249a6aa72b63029322d5c986632915c.jpg saved to cache
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW64430/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd256db0-a53a-5002-bbae-cb63638ac8cc with identifier: YK05158
2026-01-28 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd256db0-a53a-5002-bbae-cb63638ac8cc with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd256db0-a53a-5002-bbae-cb63638ac8cc with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd256db0-a53a-5002-bbae-cb63638ac8cc, identifier: YK05158
2026-01-28 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf89f4fd-6a69-5253-91b0-04b97fdbd415 with identifier: FC73601
2026-01-28 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf89f4fd-6a69-5253-91b0-04b97fdbd415 with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf89f4fd-6a69-5253-91b0-04b97fdbd415 with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf89f4fd-6a69-5253-91b0-04b97fdbd415, identifier: FC73601
2026-01-28 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with identifier: HS37774
2026-01-28 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b, identifier: HS37774
2026-01-28 17:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with identifier: MU76690
2026-01-28 17:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with scrape type 2
2026-01-28 17:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7, identifier: MU76690
2026-01-28 17:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd256db0-a53a-5002-bbae-cb63638ac8cc with identifier: YK05158
2026-01-28 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd256db0-a53a-5002-bbae-cb63638ac8cc with identifier: YK05158
2026-01-28 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183681 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183681
2026-01-28 17:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bd256db0-a53a-5002-bbae-cb63638ac8cc spider: auto1.es
2026-01-28 17:01:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bd256db0-a53a-5002-bbae-cb63638ac8cc due to rule: high_mileage_for_country.json, error: 183681 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183681
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 197,
 'expiration_date': '2026-01-29T16:12:27Z',
 'fuel_type': 'hybrid',
 'id': 'bd256db0-a53a-5002-bbae-cb63638ac8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK05158',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Lexus',
 'model': 'NX-Serie',
 'odometer': 183681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus NX-Serie NX 300h Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2018}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK05158%27 HTTP/1.1" 200 None
2026-01-28 17:01:52 [auto1.es] INFO: Saving data for YK05158: {'auction_closing_time': 1769703147.0, 'created_time': 1769519388.175424, 'last_price_update_time': 1769619712.080764}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK05158') HTTP/1.1" 204 0
2026-01-28 17:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf89f4fd-6a69-5253-91b0-04b97fdbd415 with identifier: FC73601
2026-01-28 17:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf89f4fd-6a69-5253-91b0-04b97fdbd415 with identifier: FC73601
2026-01-28 17:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf89f4fd-6a69-5253-91b0-04b97fdbd415 with identifier: FC73601 to the API
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FC73601>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:32:29Z',
 'fuel_type': 'petrol',
 'id': 'cf89f4fd-6a69-5253-91b0-04b97fdbd415',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC73601',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 41903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC73601%27 HTTP/1.1" 200 None
2026-01-28 17:01:52 [auto1.es] INFO: Saving data for FC73601: {'auction_closing_time': 1769704349.0, 'created_time': 1768475998.754507, 'last_price_update_time': 1769619712.420235}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FC73601') HTTP/1.1" 204 0
2026-01-28 17:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with identifier: HS37774
2026-01-28 17:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with identifier: HS37774
2026-01-28 17:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b with identifier: HS37774 to the API
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HS37774>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:19:34Z',
 'fuel_type': 'hybrid',
 'id': '71fbf9cc-5e5b-5b77-9620-0bb8214c9e7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS37774',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 13495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-02-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Plus',
 'transmission': 'automatic',
 'trim': '2WD Active Plus',
 'year': 2024}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS37774%27 HTTP/1.1" 200 None
2026-01-28 17:01:52 [auto1.es] INFO: Saving data for HS37774: {'auction_closing_time': 1769703574.0, 'created_time': 1768842069.679509, 'last_price_update_time': 1769619712.737417}
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HS37774') HTTP/1.1" 204 0
2026-01-28 17:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with identifier: MU76690
2026-01-28 17:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with identifier: MU76690
2026-01-28 17:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7fc533a3-e7a6-5077-aafd-cde3ea47b5a7 with identifier: MU76690 to the API
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MU76690>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:53:51Z',
 'fuel_type': 'petrol',
 'id': '7fc533a3-e7a6-5077-aafd-cde3ea47b5a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU76690',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 39150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU76690%27 HTTP/1.1" 200 None
2026-01-28 17:01:53 [auto1.es] INFO: Saving data for MU76690: {'auction_closing_time': 1769705631.0, 'created_time': 1769101717.154017, 'last_price_update_time': 1769619713.039874}
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MU76690') HTTP/1.1" 204 0
2026-01-28 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL47969> (referer: https://www.auto1.com/v1/car-details-view/LL47969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PE50169> (referer: https://www.auto1.com/v1/car-details-view/PE50169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629f9b90>
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg saved to cache
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6296f790>
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg saved to cache
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with identifier: LL47969
2026-01-28 17:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with scrape type 2
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with scrape type 2
2026-01-28 17:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 994a025d-7fa3-5a00-b3a7-fc117ed1f00e, identifier: LL47969
2026-01-28 17:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with identifier: PE50169
2026-01-28 17:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with scrape type 2
2026-01-28 17:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with scrape type 2
2026-01-28 17:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfbd9117-dfc4-54c0-99ec-e409dd90ff59, identifier: PE50169
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6bdd0>
2026-01-28 17:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F93%252Ff993a749c95e48983d8f04a7c1395f3b%252Fpa%252FNS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg') HTTP/1.1" 204 0
2026-01-28 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg saved to cache
2026-01-28 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93599d54-edcf-5cc2-862b-34cad24d20ad
2026-01-28 17:01:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93599d54-edcf-5cc2-862b-34cad24d20ad, skipping ID generation
2026-01-28 17:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93599d54-edcf-5cc2-862b-34cad24d20ad with scrape type 1
2026-01-28 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 93599d54-edcf-5cc2-862b-34cad24d20ad from tracking dictionaries
2026-01-28 17:01:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93599d54-edcf-5cc2-862b-34cad24d20ad sending to next pipeline
2026-01-28 17:01:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 93599d54-edcf-5cc2-862b-34cad24d20ad, identifier: NS64232
2026-01-28 17:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with identifier: LL47969
2026-01-28 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with identifier: LL47969
2026-01-28 17:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 994a025d-7fa3-5a00-b3a7-fc117ed1f00e with identifier: LL47969 to the API
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LL47969>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:05:47Z',
 'fuel_type': 'petrol',
 'id': '994a025d-7fa3-5a00-b3a7-fc117ed1f00e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL47969',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 18704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.5 TSI ACT FR XL',
 'transmission': 'automatic',
 'trim': 'FR XL',
 'year': 2023}
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL47969%27 HTTP/1.1" 200 None
2026-01-28 17:01:54 [auto1.es] INFO: Saving data for LL47969: {'auction_closing_time': 1769702747.0, 'created_time': 1768888899.670192, 'last_price_update_time': 1769619714.703572}
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LL47969') HTTP/1.1" 204 0
2026-01-28 17:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with identifier: PE50169
2026-01-28 17:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with identifier: PE50169
2026-01-28 17:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bfbd9117-dfc4-54c0-99ec-e409dd90ff59 with identifier: PE50169 to the API
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PE50169>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:35Z',
 'fuel_type': 'diesel',
 'id': 'bfbd9117-dfc4-54c0-99ec-e409dd90ff59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE50169',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 77623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D3 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2017}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PE50169%27 HTTP/1.1" 200 None
2026-01-28 17:01:55 [auto1.es] INFO: Saving data for PE50169: {'auction_closing_time': 1769703335.0, 'created_time': 1769003248.9972, 'last_price_update_time': 1769619715.023697}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PE50169') HTTP/1.1" 204 0
2026-01-28 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 93599d54-edcf-5cc2-862b-34cad24d20ad with identifier: NS64232
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 93599d54-edcf-5cc2-862b-34cad24d20ad with identifier: NS64232
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 93599d54-edcf-5cc2-862b-34cad24d20ad spider: auto1.es
2026-01-28 17:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 93599d54-edcf-5cc2-862b-34cad24d20ad due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 251,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:37:59Z',
 'fuel_type': 'diesel',
 'id': '93599d54-edcf-5cc2-862b-34cad24d20ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS64232',
 'listing': 'auction',
 'location': 'ES, Elche',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 145570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_6b994b8b9d092018ab8f5bfac64766d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_e3d314764df8d65b8f742f672c57d542.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_7ed5231ed06be0f4fde2ca1fb8461eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b28aef9ea2bb8e4b6bf429e73dcba669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b2008b940f78b9fad32bbb555f020f22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76621,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0e982cf1e1ab2d40443023b0a0254de5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_f4de21735475db27f255fbeabba5872d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_b249a6aa72b63029322d5c986632915c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_4a48afc2fca49407c9302ac56a61efb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8bfdf15a574e47457a5e95afd23e8eb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_8c44ddece04b98bae6972d12e48cec93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0cad3e166a284cab47590dc8703e1216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57705,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_98cbd3f76013c72270774d8e1c2c764a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2072712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_01c98be91059e41740f557680c68b69b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_0a7e51a4a083670601b457accf350315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93599d54-edcf-5cc2-862b-34cad24d20ad/93599d54-edcf-5cc2-862b-34cad24d20ad_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/93/f993a749c95e48983d8f04a7c1395f3b/pa/NS64232_1256779ba8cb229cff0d4de167775e8a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-11',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L4 Trend',
 'transmission': 'manual',
 'trim': '350 L4 Trend',
 'year': 2020}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS64232%27 HTTP/1.1" 200 None
2026-01-28 17:01:55 [auto1.es] INFO: Saving data for NS64232: {'created_time': 1769619715.261575, 'last_price_update_time': 1769619715.261585, 'auction_closing_time': 1769704679.0}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NS64232') HTTP/1.1" 204 0
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA43720> (referer: https://www.auto1.com/v1/car-details-view/SA43720/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG18347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ93542/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG43398> (referer: https://www.auto1.com/v1/car-details-view/TG43398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT07824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC75679> (referer: https://www.auto1.com/v1/car-details-view/UC75679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3f88df-7769-5152-9411-4ecae57a26aa with identifier: SA43720
2026-01-28 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3f88df-7769-5152-9411-4ecae57a26aa with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3f88df-7769-5152-9411-4ecae57a26aa with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f3f88df-7769-5152-9411-4ecae57a26aa, identifier: SA43720
2026-01-28 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f3f88df-7769-5152-9411-4ecae57a26aa with identifier: SA43720
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f3f88df-7769-5152-9411-4ecae57a26aa with identifier: SA43720
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176396 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176396
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2f3f88df-7769-5152-9411-4ecae57a26aa spider: auto1.es
2026-01-28 17:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2f3f88df-7769-5152-9411-4ecae57a26aa due to rule: high_mileage_for_country.json, error: 176396 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176396
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6B',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:14:55Z',
 'fuel_type': 'diesel',
 'id': '2f3f88df-7769-5152-9411-4ecae57a26aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA43720',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 176396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2018}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA43720%27 HTTP/1.1" 200 None
2026-01-28 17:01:55 [auto1.es] INFO: Saving data for SA43720: {'auction_closing_time': 1769703295.0, 'created_time': 1769533265.922611, 'last_price_update_time': 1769619715.755632}
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA43720') HTTP/1.1" 204 0
2026-01-28 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cf1833-aaf1-510e-b898-a5c167dd668f with identifier: TG43398
2026-01-28 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cf1833-aaf1-510e-b898-a5c167dd668f with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cf1833-aaf1-510e-b898-a5c167dd668f with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d8cf1833-aaf1-510e-b898-a5c167dd668f, identifier: TG43398
2026-01-28 17:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69874772-8d7d-5301-9b38-b58345c94194 with identifier: UC75679
2026-01-28 17:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69874772-8d7d-5301-9b38-b58345c94194 with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69874772-8d7d-5301-9b38-b58345c94194 with scrape type 2
2026-01-28 17:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69874772-8d7d-5301-9b38-b58345c94194, identifier: UC75679
2026-01-28 17:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d8cf1833-aaf1-510e-b898-a5c167dd668f with identifier: TG43398
2026-01-28 17:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d8cf1833-aaf1-510e-b898-a5c167dd668f with identifier: TG43398
2026-01-28 17:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d8cf1833-aaf1-510e-b898-a5c167dd668f with identifier: TG43398 to the API
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TG43398>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:51:53Z',
 'fuel_type': 'diesel',
 'id': 'd8cf1833-aaf1-510e-b898-a5c167dd668f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG43398',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 58231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2021}
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG43398%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [auto1.es] INFO: Saving data for TG43398: {'auction_closing_time': 1769705513.0, 'created_time': 1769519343.06658, 'last_price_update_time': 1769619716.30567}
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG43398') HTTP/1.1" 204 0
2026-01-28 17:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69874772-8d7d-5301-9b38-b58345c94194 with identifier: UC75679
2026-01-28 17:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69874772-8d7d-5301-9b38-b58345c94194 with identifier: UC75679
2026-01-28 17:01:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 69874772-8d7d-5301-9b38-b58345c94194 with identifier: UC75679 to the API
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC75679>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:32:25Z',
 'fuel_type': 'petrol',
 'id': '69874772-8d7d-5301-9b38-b58345c94194',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC75679',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Fiat',
 'model': '500',
 'odometer': 41317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 DolceVita',
 'transmission': 'manual',
 'trim': 'DolceVita',
 'year': 2021}
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC75679%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [auto1.es] INFO: Saving data for UC75679: {'auction_closing_time': 1769704345.0, 'created_time': 1769003241.389369, 'last_price_update_time': 1769619716.612263}
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC75679') HTTP/1.1" 204 0
2026-01-28 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK17684> (referer: https://www.auto1.com/v1/car-details-view/MK17684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB80679> (referer: https://www.auto1.com/v1/car-details-view/SB80679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c17ad3dc-220d-5252-8af4-5cc0fa14fd7f with identifier: MK17684
2026-01-28 17:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c17ad3dc-220d-5252-8af4-5cc0fa14fd7f with scrape type 1
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item c17ad3dc-220d-5252-8af4-5cc0fa14fd7f
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_e4d0c125e8dd690df695d88f56ccb003.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_e4d0c125e8dd690df695d88f56ccb003.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_2638030d16ae31e75f9a153101991ba8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_2638030d16ae31e75f9a153101991ba8.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_6dc0abe19206e35a8fdc3f3880184a61.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_6dc0abe19206e35a8fdc3f3880184a61.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_52e25d5b85cb8d0554837d95f5840f79.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_52e25d5b85cb8d0554837d95f5840f79.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_f46f94c60ba39bba4d08ded2a3996f74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_f46f94c60ba39bba4d08ded2a3996f74.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_692eb4fa4c516fffadcd326e2896c9c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_692eb4fa4c516fffadcd326e2896c9c4.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_9b2935952ae740f7b7fb3f6e6ecf2320.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_9b2935952ae740f7b7fb3f6e6ecf2320.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_8bff36452ee0fb4a24cc14d81c46163f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_8bff36452ee0fb4a24cc14d81c46163f.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_40b59313ff526ca0c474cc1c9c144475.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_40b59313ff526ca0c474cc1c9c144475.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_4bfa4ff350443749b8cd19a91c2aa64b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_4bfa4ff350443749b8cd19a91c2aa64b.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_36bb4806444472e8b90b77c9436a727a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_36bb4806444472e8b90b77c9436a727a.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_650cfbdc0290fc5c689e083da0461486.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_650cfbdc0290fc5c689e083da0461486.jpg already downloaded
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_1a6fd138b0a898bfdaa8c4ea1d042f9a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1a6fd138b0a898bfdaa8c4ea1d042f9a.jpg already downloaded
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F5b%252Fe35b0434a01a24e0675eea1ca8174d42%252Fpa%252FMK17684_1efb2c548ea704ff22e622991c19934b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1efb2c548ea704ff22e622991c19934b.jpg already downloaded
2026-01-28 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c17ad3dc-220d-5252-8af4-5cc0fa14fd7f, identifier: MK17684
2026-01-28 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c17ad3dc-220d-5252-8af4-5cc0fa14fd7f with identifier: MK17684
2026-01-28 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c17ad3dc-220d-5252-8af4-5cc0fa14fd7f with identifier: MK17684
2026-01-28 17:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c17ad3dc-220d-5252-8af4-5cc0fa14fd7f with identifier: MK17684 to the API
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MK17684>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:09:50Z',
 'fuel_type': 'diesel',
 'id': 'c17ad3dc-220d-5252-8af4-5cc0fa14fd7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK17684',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 129771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_e4d0c125e8dd690df695d88f56ccb003.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_2638030d16ae31e75f9a153101991ba8.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_6dc0abe19206e35a8fdc3f3880184a61.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_52e25d5b85cb8d0554837d95f5840f79.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_f46f94c60ba39bba4d08ded2a3996f74.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_692eb4fa4c516fffadcd326e2896c9c4.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_9b2935952ae740f7b7fb3f6e6ecf2320.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_8bff36452ee0fb4a24cc14d81c46163f.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_40b59313ff526ca0c474cc1c9c144475.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_4bfa4ff350443749b8cd19a91c2aa64b.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_36bb4806444472e8b90b77c9436a727a.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_650cfbdc0290fc5c689e083da0461486.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1a6fd138b0a898bfdaa8c4ea1d042f9a.jpg',
                'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1efb2c548ea704ff22e622991c19934b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 334341,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_e4d0c125e8dd690df695d88f56ccb003.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_2638030d16ae31e75f9a153101991ba8.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 346788,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_6dc0abe19206e35a8fdc3f3880184a61.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_52e25d5b85cb8d0554837d95f5840f79.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345174,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_f46f94c60ba39bba4d08ded2a3996f74.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_692eb4fa4c516fffadcd326e2896c9c4.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_9b2935952ae740f7b7fb3f6e6ecf2320.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_8bff36452ee0fb4a24cc14d81c46163f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 335486,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_40b59313ff526ca0c474cc1c9c144475.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 356967,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_4bfa4ff350443749b8cd19a91c2aa64b.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 305599,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_36bb4806444472e8b90b77c9436a727a.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332491,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_650cfbdc0290fc5c689e083da0461486.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307536,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1a6fd138b0a898bfdaa8c4ea1d042f9a.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c17ad3dc-220d-5252-8af4-5cc0fa14fd7f/c17ad3dc-220d-5252-8af4-5cc0fa14fd7f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 369175,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/5b/e35b0434a01a24e0675eea1ca8174d42/pa/MK17684_1efb2c548ea704ff22e622991c19934b.jpg',
             'Width': 894}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Sprint Q4',
 'transmission': 'automatic',
 'trim': 'Sprint Q4',
 'year': 2021}
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MK17684%27 HTTP/1.1" 200 None
2026-01-28 17:01:57 [auto1.es] INFO: Saving data for MK17684: {'created_time': 1769619717.452097, 'last_price_update_time': 1769619717.452112, 'auction_closing_time': 1769702990.0}
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MK17684') HTTP/1.1" 204 0
2026-01-28 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KE41233> (referer: https://www.auto1.com/v1/car-details-view/KE41233/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with identifier: SB80679
2026-01-28 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with scrape type 2
2026-01-28 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with scrape type 2
2026-01-28 17:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75dde4ca-a6c8-56a4-a2dd-83aeaa121793, identifier: SB80679
2026-01-28 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA12453> (referer: https://www.auto1.com/v1/car-details-view/JA12453/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG01889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV27917> (referer: https://www.auto1.com/v1/car-details-view/TV27917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with identifier: SB80679
2026-01-28 17:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with identifier: SB80679
2026-01-28 17:01:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75dde4ca-a6c8-56a4-a2dd-83aeaa121793 with identifier: SB80679 to the API
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB80679>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 175,
 'expiration_date': '2026-01-29T16:08:32Z',
 'fuel_type': 'petrol',
 'id': '75dde4ca-a6c8-56a4-a2dd-83aeaa121793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB80679',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 85736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB80679%27 HTTP/1.1" 200 None
2026-01-28 17:01:57 [auto1.es] INFO: Saving data for SB80679: {'auction_closing_time': 1769702912.0, 'created_time': 1768473931.803559, 'last_price_update_time': 1769619717.887973}
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB80679') HTTP/1.1" 204 0
2026-01-28 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG66312> (referer: https://www.auto1.com/v1/car-details-view/SG66312/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a6610f-ba10-53c1-af28-b11b029047ef with identifier: KE41233
2026-01-28 17:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a6610f-ba10-53c1-af28-b11b029047ef with scrape type 2
2026-01-28 17:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a6610f-ba10-53c1-af28-b11b029047ef with scrape type 2
2026-01-28 17:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38a6610f-ba10-53c1-af28-b11b029047ef, identifier: KE41233
2026-01-28 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d with identifier: JA12453
2026-01-28 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fe7688e-7117-5eeb-abd4-273bce8bbe8d with scrape type 1
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 9fe7688e-7117-5eeb-abd4-273bce8bbe8d
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_6c5abce00c2fa3bc8ce661c0bb724184.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6c5abce00c2fa3bc8ce661c0bb724184.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_01668fe6e718ab63323f42b0b4948345.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01668fe6e718ab63323f42b0b4948345.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_55fcbb68578e22fd79a28d84fdd94dbf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_55fcbb68578e22fd79a28d84fdd94dbf.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_4f34fcd0cbe94b2212272a1ccf78a174.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_4f34fcd0cbe94b2212272a1ccf78a174.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_01747b2541439bfeef4b9ac26344a3fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01747b2541439bfeef4b9ac26344a3fa.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_e76d65d5c6ad57c179aabb84590e3605.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_e76d65d5c6ad57c179aabb84590e3605.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_f17c328d99b28fdfa1a2ec1e1239eac6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f17c328d99b28fdfa1a2ec1e1239eac6.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_f6ba943393c49fe2f11f4e33efef5aa3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f6ba943393c49fe2f11f4e33efef5aa3.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_6208c7e558817e65975ad637983e9513.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6208c7e558817e65975ad637983e9513.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_36730fa4706a7bd7f975c48ca9949d29.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_36730fa4706a7bd7f975c48ca9949d29.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_2195dec28c47d011bcc4407a77b17c4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_2195dec28c47d011bcc4407a77b17c4d.jpg already downloaded
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252Fd7%252F34d7c086a414064bf85c285983fcd213%252Fpa%252FJA12453_98f9986daf5bf0b159f48aac4d0a1e22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_98f9986daf5bf0b159f48aac4d0a1e22.jpg already downloaded
2026-01-28 17:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d, identifier: JA12453
2026-01-28 17:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496b78d9-254c-52fd-98b4-62224c06965d with identifier: TV27917
2026-01-28 17:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496b78d9-254c-52fd-98b4-62224c06965d with scrape type 2
2026-01-28 17:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 496b78d9-254c-52fd-98b4-62224c06965d with scrape type 2
2026-01-28 17:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 496b78d9-254c-52fd-98b4-62224c06965d, identifier: TV27917
2026-01-28 17:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38a6610f-ba10-53c1-af28-b11b029047ef with identifier: KE41233
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38a6610f-ba10-53c1-af28-b11b029047ef with identifier: KE41233
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech shine m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 98983, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke41233', 'expiration_date': '2026-01-29t16:04:39z', 'origin_country_code': 'es', 'trim': 'shine m', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, manacor', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 160, 'id': '38a6610f-ba10-53c1-af28-b11b029047ef', 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 98983}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 160,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:39z',
     'fuel_type': 'petrol',
     'id': '38a6610f-ba10-53c1-af28-b11b029047ef',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke41233',
     'listing': 'auction',
     'location': 'es, manacor',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 98983,
     'odometer_in_km': 98983,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech shine m',
     'transmission': 'manual',
     'trim': 'shine m',
     'year': 2018}
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 38a6610f-ba10-53c1-af28-b11b029047ef spider: auto1.es
2026-01-28 17:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38a6610f-ba10-53c1-af28-b11b029047ef due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech shine m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 98983, 'odometer_reading_unit': 'km', 'registration_date': '2018-08-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke41233', 'expiration_date': '2026-01-29t16:04:39z', 'origin_country_code': 'es', 'trim': 'shine m', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, manacor', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 160, 'id': '38a6610f-ba10-53c1-af28-b11b029047ef', 'current_year_diff': 8, 'age_in_months': 89, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 98983}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 89,
     'auction_title': '',
     'c_o_2_emission_value': 160,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:04:39z',
     'fuel_type': 'petrol',
     'id': '38a6610f-ba10-53c1-af28-b11b029047ef',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ke41233',
     'listing': 'auction',
     'location': 'es, manacor',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 98983,
     'odometer_in_km': 98983,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-08-26',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech shine m',
     'transmission': 'manual',
     'trim': 'shine m',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:04:39Z',
 'fuel_type': 'petrol',
 'id': '38a6610f-ba10-53c1-af28-b11b029047ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE41233',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 98983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2018}
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KE41233%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [auto1.es] INFO: Saving data for KE41233: {'auction_closing_time': 1769702679.0, 'created_time': 1769519643.508796, 'last_price_update_time': 1769619718.677814}
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KE41233') HTTP/1.1" 204 0
2026-01-28 17:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d with identifier: JA12453
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d with identifier: JA12453
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d spider: auto1.es
2026-01-28 17:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9fe7688e-7117-5eeb-abd4-273bce8bbe8d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'ducato' containing 'ducato'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:28:37Z',
 'fuel_type': 'diesel',
 'id': '9fe7688e-7117-5eeb-abd4-273bce8bbe8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA12453',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 150984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6c5abce00c2fa3bc8ce661c0bb724184.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01668fe6e718ab63323f42b0b4948345.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_55fcbb68578e22fd79a28d84fdd94dbf.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_4f34fcd0cbe94b2212272a1ccf78a174.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01747b2541439bfeef4b9ac26344a3fa.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_e76d65d5c6ad57c179aabb84590e3605.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f17c328d99b28fdfa1a2ec1e1239eac6.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f6ba943393c49fe2f11f4e33efef5aa3.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6208c7e558817e65975ad637983e9513.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_36730fa4706a7bd7f975c48ca9949d29.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_2195dec28c47d011bcc4407a77b17c4d.jpg',
                'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_98f9986daf5bf0b159f48aac4d0a1e22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6c5abce00c2fa3bc8ce661c0bb724184.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01668fe6e718ab63323f42b0b4948345.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_55fcbb68578e22fd79a28d84fdd94dbf.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333939,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_4f34fcd0cbe94b2212272a1ccf78a174.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 333939,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_01747b2541439bfeef4b9ac26344a3fa.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_e76d65d5c6ad57c179aabb84590e3605.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362960,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f17c328d99b28fdfa1a2ec1e1239eac6.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 362960,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_f6ba943393c49fe2f11f4e33efef5aa3.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_6208c7e558817e65975ad637983e9513.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 324019,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_36730fa4706a7bd7f975c48ca9949d29.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 258154,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_2195dec28c47d011bcc4407a77b17c4d.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9fe7688e-7117-5eeb-abd4-273bce8bbe8d/9fe7688e-7117-5eeb-abd4-273bce8bbe8d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/d7/34d7c086a414064bf85c285983fcd213/pa/JA12453_98f9986daf5bf0b159f48aac4d0a1e22.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-19',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA12453%27 HTTP/1.1" 200 None
2026-01-28 17:01:58 [auto1.es] INFO: Saving data for JA12453: {'created_time': 1769619718.912623, 'last_price_update_time': 1769619718.912634, 'auction_closing_time': 1769704117.0}
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JA12453') HTTP/1.1" 204 0
2026-01-28 17:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 496b78d9-254c-52fd-98b4-62224c06965d with identifier: TV27917
2026-01-28 17:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 496b78d9-254c-52fd-98b4-62224c06965d with identifier: TV27917
2026-01-28 17:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 496b78d9-254c-52fd-98b4-62224c06965d with identifier: TV27917 to the API
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV27917>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-01-29T16:55:58Z',
 'fuel_type': 'diesel',
 'id': '496b78d9-254c-52fd-98b4-62224c06965d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV27917',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 112702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV27917%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [auto1.es] INFO: Saving data for TV27917: {'auction_closing_time': 1769705758.0, 'created_time': 1769003350.695744, 'last_price_update_time': 1769619719.243729}
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV27917') HTTP/1.1" 204 0
2026-01-28 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ38594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW64430> (referer: https://www.auto1.com/v1/car-details-view/EW64430/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 with identifier: SG66312
2026-01-28 17:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 with scrape type 1
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_cd2f302fd78988d9cf0a1984057123ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_cd2f302fd78988d9cf0a1984057123ec.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_d3a350c9d17c74b705573b98b782d464.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_d3a350c9d17c74b705573b98b782d464.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_7635e13508c5183b0c0d54a78c75cae4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7635e13508c5183b0c0d54a78c75cae4.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_c8e960b891e373e085b5cd62f3b441c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_c8e960b891e373e085b5cd62f3b441c8.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_7aeac94a9e16a0992093ee44f9b969c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7aeac94a9e16a0992093ee44f9b969c3.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_595fcb72ab8e4d6d1dd29d2c1a849661.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_595fcb72ab8e4d6d1dd29d2c1a849661.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_b2b78194097ae22d5b28369301addb5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_b2b78194097ae22d5b28369301addb5b.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_aff1252bcb580253204e59186dbed40f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_aff1252bcb580253204e59186dbed40f.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_5cac31ce9255048033de84ace37ec317.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_5cac31ce9255048033de84ace37ec317.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_ed96799c3edeaec580bc0f6fd6d3699f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_ed96799c3edeaec580bc0f6fd6d3699f.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_f7375bd0f4fadbf74b846697e04ecdd3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_f7375bd0f4fadbf74b846697e04ecdd3.jpg already downloaded
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe3%252F0ae349ec074937b85b8c377afa269cfd%252Fpa%252FSG66312_76930a82337a6eda3537a43e795b83ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_76930a82337a6eda3537a43e795b83ce.jpg already downloaded
2026-01-28 17:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030, identifier: SG66312
2026-01-28 17:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 with identifier: SG66312
2026-01-28 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 with identifier: SG66312
2026-01-28 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'scudo' containing 'scudo'
2026-01-28 17:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 spider: auto1.es
2026-01-28 17:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'scudo' containing 'scudo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:25:09Z',
 'fuel_type': 'diesel',
 'id': 'b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66312',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Scudo',
 'odometer': 92444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_cd2f302fd78988d9cf0a1984057123ec.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_d3a350c9d17c74b705573b98b782d464.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7635e13508c5183b0c0d54a78c75cae4.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_c8e960b891e373e085b5cd62f3b441c8.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7aeac94a9e16a0992093ee44f9b969c3.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_595fcb72ab8e4d6d1dd29d2c1a849661.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_b2b78194097ae22d5b28369301addb5b.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_aff1252bcb580253204e59186dbed40f.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_5cac31ce9255048033de84ace37ec317.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_ed96799c3edeaec580bc0f6fd6d3699f.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_f7375bd0f4fadbf74b846697e04ecdd3.jpg',
                'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_76930a82337a6eda3537a43e795b83ce.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38956,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_cd2f302fd78988d9cf0a1984057123ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38956,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_d3a350c9d17c74b705573b98b782d464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40374,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7635e13508c5183b0c0d54a78c75cae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40374,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_c8e960b891e373e085b5cd62f3b441c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47880,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_7aeac94a9e16a0992093ee44f9b969c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56233,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_595fcb72ab8e4d6d1dd29d2c1a849661.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38956,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_b2b78194097ae22d5b28369301addb5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38956,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_aff1252bcb580253204e59186dbed40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38227,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_5cac31ce9255048033de84ace37ec317.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40180,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_ed96799c3edeaec580bc0f6fd6d3699f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68311,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_f7375bd0f4fadbf74b846697e04ecdd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030/b8ff80a3-a4e8-5ba7-96fb-6f738eb1a030_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40180,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e3/0ae349ec074937b85b8c377afa269cfd/pa/SG66312_76930a82337a6eda3537a43e795b83ce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Scudo 1.5 M-Jet L2',
 'transmission': 'manual',
 'trim': 'L2',
 'year': 2022}
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG66312%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [auto1.es] INFO: Saving data for SG66312: {'created_time': 1769619719.857606, 'last_price_update_time': 1769619719.857616, 'auction_closing_time': 1769703909.0}
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG66312') HTTP/1.1" 204 0
2026-01-28 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR27466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA80546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb4d38d-fd53-57ca-8c81-66f14604cdb3 with identifier: EW64430
2026-01-28 17:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb4d38d-fd53-57ca-8c81-66f14604cdb3 with scrape type 1
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_10f480a275fec34a6a39bd976d896d50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_10f480a275fec34a6a39bd976d896d50.jpg not downloaded yet
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_d9465754be9215e8b151fd596c2d9510.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_d9465754be9215e8b151fd596c2d9510.jpg not downloaded yet
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg not downloaded yet
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg not downloaded yet
2026-01-28 17:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_c21e02065bace4be6d6ef53400c1758b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c21e02065bace4be6d6ef53400c1758b.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_fc02b1c368900c05fffbd248cefc0a04.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_fc02b1c368900c05fffbd248cefc0a04.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8ca939d08bd6032b399aa34deb5eba60.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8ca939d08bd6032b399aa34deb5eba60.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_48e2ed4c23334754b39d27c165c02d53.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_48e2ed4c23334754b39d27c165c02d53.jpg not downloaded yet
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg not downloaded yet
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL57759/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT92350/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62874910>
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg saved to cache
2026-01-28 17:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_48e2ed4c23334754b39d27c165c02d53.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW48734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS52157> (referer: https://www.auto1.com/v1/car-details-view/PS52157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT07824> (referer: https://www.auto1.com/v1/car-details-view/AT07824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346fdd0>
2026-01-28 17:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg saved to cache
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG18347> (referer: https://www.auto1.com/v1/car-details-view/SG18347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ93542> (referer: https://www.auto1.com/v1/car-details-view/AJ93542/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6332ed90>
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_48e2ed4c23334754b39d27c165c02d53.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_48e2ed4c23334754b39d27c165c02d53.jpg saved to cache
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccca3e64-8b65-5485-ab00-1558d12f9b3f with identifier: PS52157
2026-01-28 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccca3e64-8b65-5485-ab00-1558d12f9b3f with scrape type 1
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ccca3e64-8b65-5485-ab00-1558d12f9b3f
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_950fd287a13f03d297dfc1bebcb617b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_950fd287a13f03d297dfc1bebcb617b8.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_9ea25729f5fcddc5487c9ebab9a427ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9ea25729f5fcddc5487c9ebab9a427ae.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_3d876f6feda7a7dce8d41962742c320d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_3d876f6feda7a7dce8d41962742c320d.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_b29cd4ca103a4871f8ab98511404884d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b29cd4ca103a4871f8ab98511404884d.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_d3540580389bf056ddf9461db383a105.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d3540580389bf056ddf9461db383a105.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_b47306e2160d3151f0a677b04ea944c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b47306e2160d3151f0a677b04ea944c4.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_e0a88732b874298b732f1522ab110d18.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_e0a88732b874298b732f1522ab110d18.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_baa58e6f6ac734f4cb165458b666c36b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_baa58e6f6ac734f4cb165458b666c36b.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_4cb09e841d7360f19faf22ad05c98834.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_4cb09e841d7360f19faf22ad05c98834.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_704eb920d53022c38d9de3422a369f9a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_704eb920d53022c38d9de3422a369f9a.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_d71a81fafb3d7e9e17078535af17878d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d71a81fafb3d7e9e17078535af17878d.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_455f9d836aec949338ce85b91bba60fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_455f9d836aec949338ce85b91bba60fb.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_7660fc8acc30f8e9f2b89529448428ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_7660fc8acc30f8e9f2b89529448428ca.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_567f43572015d24e351522f86821f6af.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_567f43572015d24e351522f86821f6af.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_f0475de4037801e53f853187fec80d56.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_f0475de4037801e53f853187fec80d56.jpg already downloaded
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252Fd2%252F96d2b6530fb2e7e80a771985099b7ae8%252Fpa%252FPS52157_9f2d9d37cd861f2ebaff837d76567ea3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9f2d9d37cd861f2ebaff837d76567ea3.jpg already downloaded
2026-01-28 17:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ccca3e64-8b65-5485-ab00-1558d12f9b3f, identifier: PS52157
2026-01-28 17:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a8d4610-7993-5d3d-b309-0cacf5eecce9 with identifier: AT07824
2026-01-28 17:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a8d4610-7993-5d3d-b309-0cacf5eecce9 with scrape type 2
2026-01-28 17:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a8d4610-7993-5d3d-b309-0cacf5eecce9 with scrape type 2
2026-01-28 17:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a8d4610-7993-5d3d-b309-0cacf5eecce9, identifier: AT07824
2026-01-28 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ccca3e64-8b65-5485-ab00-1558d12f9b3f with identifier: PS52157
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ccca3e64-8b65-5485-ab00-1558d12f9b3f with identifier: PS52157
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164326 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164326
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ccca3e64-8b65-5485-ab00-1558d12f9b3f spider: auto1.es
2026-01-28 17:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ccca3e64-8b65-5485-ab00-1558d12f9b3f due to rule: high_mileage_for_country.json, error: 164326 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164326
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:39:17Z',
 'fuel_type': 'diesel',
 'id': 'ccca3e64-8b65-5485-ab00-1558d12f9b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS52157',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 164326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_950fd287a13f03d297dfc1bebcb617b8.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9ea25729f5fcddc5487c9ebab9a427ae.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_3d876f6feda7a7dce8d41962742c320d.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b29cd4ca103a4871f8ab98511404884d.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d3540580389bf056ddf9461db383a105.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b47306e2160d3151f0a677b04ea944c4.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_e0a88732b874298b732f1522ab110d18.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_baa58e6f6ac734f4cb165458b666c36b.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_4cb09e841d7360f19faf22ad05c98834.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_704eb920d53022c38d9de3422a369f9a.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d71a81fafb3d7e9e17078535af17878d.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_455f9d836aec949338ce85b91bba60fb.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_7660fc8acc30f8e9f2b89529448428ca.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_567f43572015d24e351522f86821f6af.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_f0475de4037801e53f853187fec80d56.jpg',
                'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9f2d9d37cd861f2ebaff837d76567ea3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_950fd287a13f03d297dfc1bebcb617b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9ea25729f5fcddc5487c9ebab9a427ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_3d876f6feda7a7dce8d41962742c320d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b29cd4ca103a4871f8ab98511404884d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d3540580389bf056ddf9461db383a105.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_b47306e2160d3151f0a677b04ea944c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_e0a88732b874298b732f1522ab110d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_baa58e6f6ac734f4cb165458b666c36b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_4cb09e841d7360f19faf22ad05c98834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_704eb920d53022c38d9de3422a369f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_d71a81fafb3d7e9e17078535af17878d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_455f9d836aec949338ce85b91bba60fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_7660fc8acc30f8e9f2b89529448428ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_567f43572015d24e351522f86821f6af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_f0475de4037801e53f853187fec80d56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccca3e64-8b65-5485-ab00-1558d12f9b3f/ccca3e64-8b65-5485-ab00-1558d12f9b3f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/d2/96d2b6530fb2e7e80a771985099b7ae8/pa/PS52157_9f2d9d37cd861f2ebaff837d76567ea3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum 2WD',
 'transmission': 'manual',
 'trim': 'Momentum 2WD',
 'year': 2019}
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS52157%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [auto1.es] INFO: Saving data for PS52157: {'created_time': 1769619722.237287, 'last_price_update_time': 1769619722.237299, 'auction_closing_time': 1769704757.0}
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PS52157') HTTP/1.1" 204 0
2026-01-28 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a8d4610-7993-5d3d-b309-0cacf5eecce9 with identifier: AT07824
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a8d4610-7993-5d3d-b309-0cacf5eecce9 with identifier: AT07824
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8a8d4610-7993-5d3d-b309-0cacf5eecce9 spider: auto1.es
2026-01-28 17:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8a8d4610-7993-5d3d-b309-0cacf5eecce9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:23Z',
 'fuel_type': 'diesel',
 'id': '8a8d4610-7993-5d3d-b309-0cacf5eecce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT07824',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 90832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
 'transmission': 'manual',
 'trim': 'Allure L1',
 'year': 2019}
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT07824%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [auto1.es] INFO: Saving data for AT07824: {'auction_closing_time': 1769703623.0, 'created_time': 1769519052.760109, 'last_price_update_time': 1769619722.627173}
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT07824') HTTP/1.1" 204 0
2026-01-28 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP16982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH55532> (referer: https://www.auto1.com/v1/car-details-view/AH55532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK91545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de355500-c779-58a2-b960-c43770be5046 with identifier: SG18347
2026-01-28 17:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de355500-c779-58a2-b960-c43770be5046 with scrape type 1
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item de355500-c779-58a2-b960-c43770be5046
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_d6b4d21cd753e10f05cf94ee2b0153d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_d6b4d21cd753e10f05cf94ee2b0153d8.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_412e8b35d451d7bda6b035b1fb971909.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_412e8b35d451d7bda6b035b1fb971909.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_7176efbd99fda1e22b84d2450f9f21da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7176efbd99fda1e22b84d2450f9f21da.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_a1dc30ab29b9fefb9b05bf129bd9ec54.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a1dc30ab29b9fefb9b05bf129bd9ec54.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_91fb43201afc8cfedc7f8d59865d992e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_91fb43201afc8cfedc7f8d59865d992e.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_c27b92db430b8d646b291bb22eaf26fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_c27b92db430b8d646b291bb22eaf26fc.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_94dd454882b715f86fee0b0b84baedf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_94dd454882b715f86fee0b0b84baedf4.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_7fe8e955d90733966b06a8d538454f96.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7fe8e955d90733966b06a8d538454f96.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_a634765fef2e9cb72a7e4da51b0be047.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a634765fef2e9cb72a7e4da51b0be047.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_24101cdc69d6310c9ac1678b07916d31.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_24101cdc69d6310c9ac1678b07916d31.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_cd1f71d059a00276f732c59e5d7d2059.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_cd1f71d059a00276f732c59e5d7d2059.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_09a16e0c81517903e48b88a274390f1e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_09a16e0c81517903e48b88a274390f1e.jpg already downloaded
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F8b%252F418b6e47902ad02885074de9351d9b05%252Fpa%252FSG18347_889a1e26296d6ecf6eb0d4f1fba26f4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_889a1e26296d6ecf6eb0d4f1fba26f4a.jpg already downloaded
2026-01-28 17:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de355500-c779-58a2-b960-c43770be5046, identifier: SG18347
2026-01-28 17:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7166046b-9d71-5d75-b6c9-48cc94815df0 with identifier: AJ93542
2026-01-28 17:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7166046b-9d71-5d75-b6c9-48cc94815df0 with scrape type 2
2026-01-28 17:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7166046b-9d71-5d75-b6c9-48cc94815df0 with scrape type 2
2026-01-28 17:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7166046b-9d71-5d75-b6c9-48cc94815df0, identifier: AJ93542
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8ca939d08bd6032b399aa34deb5eba60.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de355500-c779-58a2-b960-c43770be5046 with identifier: SG18347
2026-01-28 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de355500-c779-58a2-b960-c43770be5046 with identifier: SG18347
2026-01-28 17:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: de355500-c779-58a2-b960-c43770be5046 with identifier: SG18347 to the API
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG18347>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:51:58Z',
 'fuel_type': 'petrol',
 'id': 'de355500-c779-58a2-b960-c43770be5046',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG18347',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 91506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_d6b4d21cd753e10f05cf94ee2b0153d8.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_412e8b35d451d7bda6b035b1fb971909.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7176efbd99fda1e22b84d2450f9f21da.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a1dc30ab29b9fefb9b05bf129bd9ec54.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_91fb43201afc8cfedc7f8d59865d992e.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_c27b92db430b8d646b291bb22eaf26fc.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_94dd454882b715f86fee0b0b84baedf4.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7fe8e955d90733966b06a8d538454f96.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a634765fef2e9cb72a7e4da51b0be047.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_24101cdc69d6310c9ac1678b07916d31.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_cd1f71d059a00276f732c59e5d7d2059.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_09a16e0c81517903e48b88a274390f1e.jpg',
                'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_889a1e26296d6ecf6eb0d4f1fba26f4a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97171,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_d6b4d21cd753e10f05cf94ee2b0153d8.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97171,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_412e8b35d451d7bda6b035b1fb971909.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93993,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7176efbd99fda1e22b84d2450f9f21da.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93993,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a1dc30ab29b9fefb9b05bf129bd9ec54.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93993,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_91fb43201afc8cfedc7f8d59865d992e.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93993,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_c27b92db430b8d646b291bb22eaf26fc.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_94dd454882b715f86fee0b0b84baedf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105595,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_7fe8e955d90733966b06a8d538454f96.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_a634765fef2e9cb72a7e4da51b0be047.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81539,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_24101cdc69d6310c9ac1678b07916d31.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61897,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_cd1f71d059a00276f732c59e5d7d2059.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74654,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_09a16e0c81517903e48b88a274390f1e.jpg',
             'Width': 1280},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de355500-c779-58a2-b960-c43770be5046/de355500-c779-58a2-b960-c43770be5046_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61897,
             'Height': 960,
             'OriginUrl': 'https://img-pa.auto1.com/img41/8b/418b6e47902ad02885074de9351d9b05/pa/SG18347_889a1e26296d6ecf6eb0d4f1fba26f4a.jpg',
             'Width': 1280}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG18347%27 HTTP/1.1" 200 None
2026-01-28 17:02:03 [auto1.es] INFO: Saving data for SG18347: {'created_time': 1769619723.445738, 'last_price_update_time': 1769619723.44575, 'auction_closing_time': 1769705518.0}
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG18347') HTTP/1.1" 204 0
2026-01-28 17:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7166046b-9d71-5d75-b6c9-48cc94815df0 with identifier: AJ93542
2026-01-28 17:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7166046b-9d71-5d75-b6c9-48cc94815df0 with identifier: AJ93542
2026-01-28 17:02:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7166046b-9d71-5d75-b6c9-48cc94815df0 with identifier: AJ93542 to the API
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AJ93542>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:33:48Z',
 'fuel_type': 'petrol',
 'id': '7166046b-9d71-5d75-b6c9-48cc94815df0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ93542',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 71814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Tecno 2WD',
 'transmission': 'manual',
 'trim': 'Tecno 2WD',
 'year': 2019}
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ93542%27 HTTP/1.1" 200 None
2026-01-28 17:02:03 [auto1.es] INFO: Saving data for AJ93542: {'auction_closing_time': 1769704428.0, 'created_time': 1769518704.764423, 'last_price_update_time': 1769619723.775215}
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AJ93542') HTTP/1.1" 204 0
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_fc02b1c368900c05fffbd248cefc0a04.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR10719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG01889> (referer: https://www.auto1.com/v1/car-details-view/CG01889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM59707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a67450>
2026-01-28 17:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg saved to cache
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8df71cb4-864e-5f03-9a90-a0f5067762d6 with identifier: AH55532
2026-01-28 17:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8df71cb4-864e-5f03-9a90-a0f5067762d6 with scrape type 2
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8df71cb4-864e-5f03-9a90-a0f5067762d6 with scrape type 2
2026-01-28 17:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8df71cb4-864e-5f03-9a90-a0f5067762d6, identifier: AH55532
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bd810>
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg saved to cache
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282de90>
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_8ca939d08bd6032b399aa34deb5eba60.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8ca939d08bd6032b399aa34deb5eba60.jpg saved to cache
2026-01-28 17:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:04 [scrapy.extensions.logstats] INFO: Crawled 279 pages (at 142 pages/min), scraped 78 items (at 44 items/min)
2026-01-28 17:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8df71cb4-864e-5f03-9a90-a0f5067762d6 with identifier: AH55532
2026-01-28 17:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8df71cb4-864e-5f03-9a90-a0f5067762d6 with identifier: AH55532
2026-01-28 17:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8df71cb4-864e-5f03-9a90-a0f5067762d6 with identifier: AH55532 to the API
2026-01-28 17:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AH55532>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 111,
 'expiration_date': '2026-01-29T16:52:19Z',
 'fuel_type': 'petrol',
 'id': '8df71cb4-864e-5f03-9a90-a0f5067762d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH55532',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 49424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.0 T-GDI Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2022}
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH55532%27 HTTP/1.1" 200 None
2026-01-28 17:02:05 [auto1.es] INFO: Saving data for AH55532: {'auction_closing_time': 1769705539.0, 'created_time': 1767780083.608221, 'last_price_update_time': 1769619725.429112}
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH55532') HTTP/1.1" 204 0
2026-01-28 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c21e02065bace4be6d6ef53400c1758b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_d9465754be9215e8b151fd596c2d9510.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY29147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB75805/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d6b10>
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_fc02b1c368900c05fffbd248cefc0a04.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_fc02b1c368900c05fffbd248cefc0a04.jpg saved to cache
2026-01-28 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a1615c8-e4ab-5988-9654-30eb10e9627c with identifier: CG01889
2026-01-28 17:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a1615c8-e4ab-5988-9654-30eb10e9627c with scrape type 2
2026-01-28 17:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a1615c8-e4ab-5988-9654-30eb10e9627c with scrape type 2
2026-01-28 17:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1a1615c8-e4ab-5988-9654-30eb10e9627c, identifier: CG01889
2026-01-28 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1a1615c8-e4ab-5988-9654-30eb10e9627c with identifier: CG01889
2026-01-28 17:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1a1615c8-e4ab-5988-9654-30eb10e9627c with identifier: CG01889
2026-01-28 17:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1a1615c8-e4ab-5988-9654-30eb10e9627c with identifier: CG01889 to the API
2026-01-28 17:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG01889>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:47:24Z',
 'fuel_type': 'petrol',
 'id': '1a1615c8-e4ab-5988-9654-30eb10e9627c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG01889',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 116318,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2018}
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG01889%27 HTTP/1.1" 200 None
2026-01-28 17:02:06 [auto1.es] INFO: Saving data for CG01889: {'auction_closing_time': 1769705244.0, 'created_time': 1768653199.397456, 'last_price_update_time': 1769619726.135978}
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CG01889') HTTP/1.1" 204 0
2026-01-28 17:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_10f480a275fec34a6a39bd976d896d50.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62af6310>
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_c21e02065bace4be6d6ef53400c1758b.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c21e02065bace4be6d6ef53400c1758b.jpg saved to cache
2026-01-28 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633aefd0>
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg saved to cache
2026-01-28 17:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a4790>
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_d9465754be9215e8b151fd596c2d9510.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_d9465754be9215e8b151fd596c2d9510.jpg saved to cache
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT92350> (referer: https://www.auto1.com/v1/car-details-view/HT92350/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN46395> (referer: https://www.auto1.com/v1/car-details-view/YN46395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6331fad0>
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg saved to cache
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aecd50>
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fde%252Fd3de674e87efb0ceac74c014938d720d%252Fpa%252FEW64430_10f480a275fec34a6a39bd976d896d50.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_10f480a275fec34a6a39bd976d896d50.jpg saved to cache
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acb4d38d-fd53-57ca-8c81-66f14604cdb3
2026-01-28 17:02:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acb4d38d-fd53-57ca-8c81-66f14604cdb3, skipping ID generation
2026-01-28 17:02:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb4d38d-fd53-57ca-8c81-66f14604cdb3 with scrape type 1
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item acb4d38d-fd53-57ca-8c81-66f14604cdb3 from tracking dictionaries
2026-01-28 17:02:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acb4d38d-fd53-57ca-8c81-66f14604cdb3 sending to next pipeline
2026-01-28 17:02:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: acb4d38d-fd53-57ca-8c81-66f14604cdb3, identifier: EW64430
2026-01-28 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: acb4d38d-fd53-57ca-8c81-66f14604cdb3 with identifier: EW64430
2026-01-28 17:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: acb4d38d-fd53-57ca-8c81-66f14604cdb3 with identifier: EW64430
2026-01-28 17:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: acb4d38d-fd53-57ca-8c81-66f14604cdb3 with identifier: EW64430 to the API
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_10f480a275fec34a6a39bd976d896d50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:02:30Z',
 'fuel_type': 'petrol',
 'id': 'acb4d38d-fd53-57ca-8c81-66f14604cdb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW64430',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 60032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_10f480a275fec34a6a39bd976d896d50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_d9465754be9215e8b151fd596c2d9510.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196208,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_7cea34539b24d5b56d5a30e86fb43f4e.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73259,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_ff8e58739e478b4e0939fb3645a1a1b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186271,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c21e02065bace4be6d6ef53400c1758b.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_fc02b1c368900c05fffbd248cefc0a04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 242127,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_c4fb7cd0dd4ab79dcbf8f1737d83d1fc.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238767,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8ca939d08bd6032b399aa34deb5eba60.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_f6ef1fc5c4ef68d92900d70f9424a729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204855,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8fd9c70fa3219e7fddedd61a6949141d.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_48e2ed4c23334754b39d27c165c02d53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acb4d38d-fd53-57ca-8c81-66f14604cdb3/acb4d38d-fd53-57ca-8c81-66f14604cdb3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/de/d3de674e87efb0ceac74c014938d720d/pa/EW64430_8204fd98f8dafe584bdf1545e7649fb7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 Mild-Hybrid 136 Allure Pack',
 'transmission': 'automatic',
 'trim': '136 Allure Pack',
 'year': 2024}
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW64430%27 HTTP/1.1" 200 None
2026-01-28 17:02:07 [auto1.es] INFO: Saving data for EW64430: {'created_time': 1769619727.995426, 'last_price_update_time': 1769619727.995436, 'auction_closing_time': 1769702550.0}
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EW64430') HTTP/1.1" 204 0
2026-01-28 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL57759> (referer: https://www.auto1.com/v1/car-details-view/SL57759/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ38594> (referer: https://www.auto1.com/v1/car-details-view/XZ38594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a6c10>
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_f451702c4f07006bee649bc7233b3c22.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg saved to cache
2026-01-28 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90242052-3fef-5ab8-8986-cbbbd5a32a54 with identifier: HT92350
2026-01-28 17:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90242052-3fef-5ab8-8986-cbbbd5a32a54 with scrape type 2
2026-01-28 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90242052-3fef-5ab8-8986-cbbbd5a32a54 with scrape type 2
2026-01-28 17:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 90242052-3fef-5ab8-8986-cbbbd5a32a54, identifier: HT92350
2026-01-28 17:02:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0062126-c395-5f31-90d8-e93143f58cad with identifier: YN46395
2026-01-28 17:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0062126-c395-5f31-90d8-e93143f58cad with scrape type 2
2026-01-28 17:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0062126-c395-5f31-90d8-e93143f58cad with scrape type 2
2026-01-28 17:02:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0062126-c395-5f31-90d8-e93143f58cad, identifier: YN46395
2026-01-28 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 90242052-3fef-5ab8-8986-cbbbd5a32a54 with identifier: HT92350
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-01-28 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 90242052-3fef-5ab8-8986-cbbbd5a32a54 with identifier: HT92350
2026-01-28 17:02:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 90242052-3fef-5ab8-8986-cbbbd5a32a54 with identifier: HT92350 to the API
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT92350>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-01-29T16:52:17Z',
 'fuel_type': 'petrol',
 'id': '90242052-3fef-5ab8-8986-cbbbd5a32a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT92350',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 41455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.2 Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2018}
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT92350%27 HTTP/1.1" 200 None
2026-01-28 17:02:08 [auto1.es] INFO: Saving data for HT92350: {'auction_closing_time': 1769705537.0, 'created_time': 1768912871.447236, 'last_price_update_time': 1769619728.960937}
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT92350') HTTP/1.1" 204 0
2026-01-28 17:02:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0062126-c395-5f31-90d8-e93143f58cad with identifier: YN46395
2026-01-28 17:02:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0062126-c395-5f31-90d8-e93143f58cad with identifier: YN46395
2026-01-28 17:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c0062126-c395-5f31-90d8-e93143f58cad with identifier: YN46395 to the API
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN46395>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:14:43Z',
 'fuel_type': 'petrol',
 'id': 'c0062126-c395-5f31-90d8-e93143f58cad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN46395',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 108256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2017}
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN46395%27 HTTP/1.1" 200 None
2026-01-28 17:02:09 [auto1.es] INFO: Saving data for YN46395: {'auction_closing_time': 1769703283.0, 'created_time': 1769519328.72743, 'last_price_update_time': 1769619729.324293}
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN46395') HTTP/1.1" 204 0
2026-01-28 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_8464d3620e8614da9e4f1166424250d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW48734> (referer: https://www.auto1.com/v1/car-details-view/AW48734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA80546> (referer: https://www.auto1.com/v1/car-details-view/PA80546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f0710>
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_96b3adf21e146a21aabddc21a8d07648.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg saved to cache
2026-01-28 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:02:09 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bb04dd-cb06-5806-8ef3-f580e1e0999f with identifier: SL57759
2026-01-28 17:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bb04dd-cb06-5806-8ef3-f580e1e0999f with scrape type 2
2026-01-28 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4bb04dd-cb06-5806-8ef3-f580e1e0999f with scrape type 2
2026-01-28 17:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d4bb04dd-cb06-5806-8ef3-f580e1e0999f, identifier: SL57759
2026-01-28 17:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953a63a6-5ae8-549d-880f-f6e5b097a9d2 with identifier: XZ38594
2026-01-28 17:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953a63a6-5ae8-549d-880f-f6e5b097a9d2 with scrape type 2
2026-01-28 17:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953a63a6-5ae8-549d-880f-f6e5b097a9d2 with scrape type 2
2026-01-28 17:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 953a63a6-5ae8-549d-880f-f6e5b097a9d2, identifier: XZ38594
2026-01-28 17:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d4bb04dd-cb06-5806-8ef3-f580e1e0999f with identifier: SL57759
2026-01-28 17:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d4bb04dd-cb06-5806-8ef3-f580e1e0999f with identifier: SL57759
2026-01-28 17:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 55681, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sl57759', 'expiration_date': '2026-01-29t16:40:56z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'd4bb04dd-cb06-5806-8ef3-f580e1e0999f', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55681}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:56z',
     'fuel_type': 'petrol',
     'id': 'd4bb04dd-cb06-5806-8ef3-f580e1e0999f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sl57759',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 55681,
     'odometer_in_km': 55681,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2026-01-28 17:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d4bb04dd-cb06-5806-8ef3-f580e1e0999f spider: auto1.es
2026-01-28 17:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d4bb04dd-cb06-5806-8ef3-f580e1e0999f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 3008 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '3008', 'transmission': 'automatic', 'odometer': 55681, 'odometer_reading_unit': 'km', 'registration_date': '2023-04-20', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sl57759', 'expiration_date': '2026-01-29t16:40:56z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, madrid', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 147, 'id': 'd4bb04dd-cb06-5806-8ef3-f580e1e0999f', 'current_year_diff': 3, 'age_in_months': 33, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 55681}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 33,
     'auction_title': '',
     'c_o_2_emission_value': 147,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:40:56z',
     'fuel_type': 'petrol',
     'id': 'd4bb04dd-cb06-5806-8ef3-f580e1e0999f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sl57759',
     'listing': 'auction',
     'location': 'es, madrid',
     'make': 'peugeot',
     'make_model': 'peugeot 3008',
     'model': '3008',
     'odometer': 55681,
     'odometer_in_km': 55681,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-04-20',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 3008 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:40:56Z',
 'fuel_type': 'petrol',
 'id': 'd4bb04dd-cb06-5806-8ef3-f580e1e0999f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL57759',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 55681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL57759%27 HTTP/1.1" 200 None
2026-01-28 17:02:10 [auto1.es] INFO: Saving data for SL57759: {'auction_closing_time': 1769704856.0, 'created_time': 1768842084.999809, 'last_price_update_time': 1769619730.060025}
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL57759') HTTP/1.1" 204 0
2026-01-28 17:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 953a63a6-5ae8-549d-880f-f6e5b097a9d2 with identifier: XZ38594
2026-01-28 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 953a63a6-5ae8-549d-880f-f6e5b097a9d2 with identifier: XZ38594
2026-01-28 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.6 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 85574, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz38594', 'expiration_date': '2026-01-29t16:29:43z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, el prat de llobregat (barcelona)', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '953a63a6-5ae8-549d-880f-f6e5b097a9d2', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 85574}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:29:43z',
     'fuel_type': 'petrol',
     'id': '953a63a6-5ae8-549d-880f-f6e5b097a9d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz38594',
     'listing': 'auction',
     'location': 'es, el prat de llobregat (barcelona)',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 85574,
     'odometer_in_km': 85574,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-12-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.6 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2018}
2026-01-28 17:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 953a63a6-5ae8-549d-880f-f6e5b097a9d2 spider: auto1.es
2026-01-28 17:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 953a63a6-5ae8-549d-880f-f6e5b097a9d2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 5008 1.6 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '5008', 'transmission': 'automatic', 'odometer': 85574, 'odometer_reading_unit': 'km', 'registration_date': '2018-12-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz38594', 'expiration_date': '2026-01-29t16:29:43z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 181, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, el prat de llobregat (barcelona)', 'category': None, 'seats_number': 7, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 126, 'id': '953a63a6-5ae8-549d-880f-f6e5b097a9d2', 'current_year_diff': 8, 'age_in_months': 85, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 85574}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 85,
     'auction_title': '',
     'c_o_2_emission_value': 126,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 181,
     'expiration_date': '2026-01-29t16:29:43z',
     'fuel_type': 'petrol',
     'id': '953a63a6-5ae8-549d-880f-f6e5b097a9d2',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xz38594',
     'listing': 'auction',
     'location': 'es, el prat de llobregat (barcelona)',
     'make': 'peugeot',
     'make_model': 'peugeot 5008',
     'model': '5008',
     'odometer': 85574,
     'odometer_in_km': 85574,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-12-26',
     'sanitized_make': 'peugeot',
     'seats_number': 7,
     'seller_name': None,
     'title': 'peugeot 5008 1.6 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 181,
 'expiration_date': '2026-01-29T16:29:43Z',
 'fuel_type': 'petrol',
 'id': '953a63a6-5ae8-549d-880f-f6e5b097a9d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ38594',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 85574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ38594%27 HTTP/1.1" 200 None
2026-01-28 17:02:10 [auto1.es] INFO: Saving data for XZ38594: {'auction_closing_time': 1769704183.0, 'created_time': 1769518554.063812, 'last_price_update_time': 1769619730.283509}
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ38594') HTTP/1.1" 204 0
2026-01-28 17:02:10 [auto1.es] INFO: Found listing with ID: JA12453
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA12453%27 HTTP/1.1" 200 None
2026-01-28 17:02:10 [auto1.es] INFO: Scrape type for JA12453: 0
2026-01-28 17:02:10 [auto1.es] INFO: Found listing with ID: VR72202
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR72202%27 HTTP/1.1" 200 None
2026-01-28 17:02:10 [auto1.es] INFO: Scrape type for VR72202: 2
2026-01-28 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_0146b826257cfee361d1725bbcb93ce9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK91545> (referer: https://www.auto1.com/v1/car-details-view/BK91545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a3e9d0>
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg saved to cache
2026-01-28 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a3df90>
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_8464d3620e8614da9e4f1166424250d9.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_8464d3620e8614da9e4f1166424250d9.jpg saved to cache
2026-01-28 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:02:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247aff5b-0359-5e8f-888f-4cb25675899c with identifier: AW48734
2026-01-28 17:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247aff5b-0359-5e8f-888f-4cb25675899c with scrape type 2
2026-01-28 17:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247aff5b-0359-5e8f-888f-4cb25675899c with scrape type 2
2026-01-28 17:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 247aff5b-0359-5e8f-888f-4cb25675899c, identifier: AW48734
2026-01-28 17:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a76f8e6-46e9-5d2b-b115-e23a640070d1 with identifier: PA80546
2026-01-28 17:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a76f8e6-46e9-5d2b-b115-e23a640070d1 with scrape type 1
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 2a76f8e6-46e9-5d2b-b115-e23a640070d1
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_44a637abf2937d018e48e56e7953eb90.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_44a637abf2937d018e48e56e7953eb90.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_1188e49da20dea1a2465d654cbee6ece.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_1188e49da20dea1a2465d654cbee6ece.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_9faa13b8ea5c2177d1af4aa875e45c67.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_9faa13b8ea5c2177d1af4aa875e45c67.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_673e378e75b4af5de56905f416b1f742.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_673e378e75b4af5de56905f416b1f742.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_82677f69a4bf8297ecfadc15d1cdff4f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_82677f69a4bf8297ecfadc15d1cdff4f.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_368c48700d23825bd48f93d3c8d3d272.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_368c48700d23825bd48f93d3c8d3d272.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_6a0145a225290b88805d83b63cf60886.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_6a0145a225290b88805d83b63cf60886.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_7c0b09777db7cb0cf484e79f6b7cc9ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7c0b09777db7cb0cf484e79f6b7cc9ac.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_7bc8f048791a570db4a3195fabc31f6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7bc8f048791a570db4a3195fabc31f6a.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_b6fe19da52def829eb3816e501b37faf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_b6fe19da52def829eb3816e501b37faf.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_0f14a526f66b0c1fb204f01a22ea283b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_0f14a526f66b0c1fb204f01a22ea283b.jpg already downloaded
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F57%252F47578c5a4df421fa2defe7f987edfc6e%252Fpa%252FPA80546_c26d4a05868190061e2b25564a663254.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_c26d4a05868190061e2b25564a663254.jpg already downloaded
2026-01-28 17:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a76f8e6-46e9-5d2b-b115-e23a640070d1, identifier: PA80546
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: HZ35846
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ35846%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for HZ35846: 1
2026-01-28 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 247aff5b-0359-5e8f-888f-4cb25675899c with identifier: AW48734
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 247aff5b-0359-5e8f-888f-4cb25675899c with identifier: AW48734
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 247aff5b-0359-5e8f-888f-4cb25675899c spider: auto1.es
2026-01-28 17:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 247aff5b-0359-5e8f-888f-4cb25675899c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:12:50Z',
 'fuel_type': 'diesel',
 'id': '247aff5b-0359-5e8f-888f-4cb25675899c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW48734',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 123739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AW48734%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Saving data for AW48734: {'auction_closing_time': 1769703170.0, 'created_time': 1768928492.672777, 'last_price_update_time': 1769619731.578763}
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AW48734') HTTP/1.1" 204 0
2026-01-28 17:02:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a76f8e6-46e9-5d2b-b115-e23a640070d1 with identifier: PA80546
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a76f8e6-46e9-5d2b-b115-e23a640070d1 with identifier: PA80546
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'talento' containing 'talento'
2026-01-28 17:02:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2a76f8e6-46e9-5d2b-b115-e23a640070d1 spider: auto1.es
2026-01-28 17:02:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2a76f8e6-46e9-5d2b-b115-e23a640070d1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'talento' containing 'talento'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:46:20Z',
 'fuel_type': 'diesel',
 'id': '2a76f8e6-46e9-5d2b-b115-e23a640070d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA80546',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 168599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_44a637abf2937d018e48e56e7953eb90.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_1188e49da20dea1a2465d654cbee6ece.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_9faa13b8ea5c2177d1af4aa875e45c67.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_673e378e75b4af5de56905f416b1f742.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_82677f69a4bf8297ecfadc15d1cdff4f.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_368c48700d23825bd48f93d3c8d3d272.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_6a0145a225290b88805d83b63cf60886.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7c0b09777db7cb0cf484e79f6b7cc9ac.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7bc8f048791a570db4a3195fabc31f6a.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_b6fe19da52def829eb3816e501b37faf.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_0f14a526f66b0c1fb204f01a22ea283b.jpg',
                'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_c26d4a05868190061e2b25564a663254.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_44a637abf2937d018e48e56e7953eb90.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 530444,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_1188e49da20dea1a2465d654cbee6ece.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 465998,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_9faa13b8ea5c2177d1af4aa875e45c67.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_673e378e75b4af5de56905f416b1f742.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 449696,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_82677f69a4bf8297ecfadc15d1cdff4f.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_368c48700d23825bd48f93d3c8d3d272.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_6a0145a225290b88805d83b63cf60886.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7c0b09777db7cb0cf484e79f6b7cc9ac.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_7bc8f048791a570db4a3195fabc31f6a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_b6fe19da52def829eb3816e501b37faf.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_0f14a526f66b0c1fb204f01a22ea283b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a76f8e6-46e9-5d2b-b115-e23a640070d1/2a76f8e6-46e9-5d2b-b115-e23a640070d1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/57/47578c5a4df421fa2defe7f987edfc6e/pa/PA80546_c26d4a05868190061e2b25564a663254.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Talento 2.0 Turbodiesel Ecojet L1H1 1,2t',
 'transmission': 'manual',
 'trim': 'L1H1 1,2t',
 'year': 2020}
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA80546%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Saving data for PA80546: {'created_time': 1769619731.816738, 'last_price_update_time': 1769619731.816748, 'auction_closing_time': 1769705180.0}
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA80546') HTTP/1.1" 204 0
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: HK66520
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK66520%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for HK66520: 0
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: DG23873
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG23873%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for DG23873: 0
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: WK75325
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WK75325%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for WK75325: 0
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: TV84112
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV84112%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for TV84112: 1
2026-01-28 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT06855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM59707> (referer: https://www.auto1.com/v1/car-details-view/GM59707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR27466> (referer: https://www.auto1.com/v1/car-details-view/XR27466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:11 [auto1.es] INFO: Found listing with ID: VG86564
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG86564%27 HTTP/1.1" 200 None
2026-01-28 17:02:11 [auto1.es] INFO: Scrape type for VG86564: 2
2026-01-28 17:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6280bf50>
2026-01-28 17:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_0146b826257cfee361d1725bbcb93ce9.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_0146b826257cfee361d1725bbcb93ce9.jpg saved to cache
2026-01-28 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f72776-dfa9-5b90-97d0-45af48ffdb3d with identifier: BK91545
2026-01-28 17:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f72776-dfa9-5b90-97d0-45af48ffdb3d with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f72776-dfa9-5b90-97d0-45af48ffdb3d with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 12f72776-dfa9-5b90-97d0-45af48ffdb3d, identifier: BK91545
2026-01-28 17:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 12f72776-dfa9-5b90-97d0-45af48ffdb3d with identifier: BK91545
2026-01-28 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 12f72776-dfa9-5b90-97d0-45af48ffdb3d with identifier: BK91545
2026-01-28 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186485
2026-01-28 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 12f72776-dfa9-5b90-97d0-45af48ffdb3d spider: auto1.es
2026-01-28 17:02:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 12f72776-dfa9-5b90-97d0-45af48ffdb3d due to rule: high_mileage_for_country.json, error: 186485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186485
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:51:38Z',
 'fuel_type': 'diesel',
 'id': '12f72776-dfa9-5b90-97d0-45af48ffdb3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK91545',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 186485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK91545%27 HTTP/1.1" 200 None
2026-01-28 17:02:12 [auto1.es] INFO: Saving data for BK91545: {'auction_closing_time': 1769705498.0, 'created_time': 1768842209.233631, 'last_price_update_time': 1769619732.537076}
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK91545') HTTP/1.1" 204 0
2026-01-28 17:02:12 [auto1.es] INFO: Found listing with ID: DM65680
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM65680%27 HTTP/1.1" 200 None
2026-01-28 17:02:12 [auto1.es] INFO: Scrape type for DM65680: 2
2026-01-28 17:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX59239/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184d2af3-ba86-58cd-b82f-f3924b3e7832 with identifier: GM59707
2026-01-28 17:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184d2af3-ba86-58cd-b82f-f3924b3e7832 with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184d2af3-ba86-58cd-b82f-f3924b3e7832 with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 184d2af3-ba86-58cd-b82f-f3924b3e7832, identifier: GM59707
2026-01-28 17:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9988b81-9ad4-5057-8c45-c599913d905a with identifier: XR27466
2026-01-28 17:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9988b81-9ad4-5057-8c45-c599913d905a with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9988b81-9ad4-5057-8c45-c599913d905a with scrape type 2
2026-01-28 17:02:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9988b81-9ad4-5057-8c45-c599913d905a, identifier: XR27466
2026-01-28 17:02:12 [auto1.es] INFO: Found listing with ID: NB95025
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB95025%27 HTTP/1.1" 200 None
2026-01-28 17:02:12 [auto1.es] INFO: Scrape type for NB95025: 2
2026-01-28 17:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 184d2af3-ba86-58cd-b82f-f3924b3e7832 with identifier: GM59707
2026-01-28 17:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 184d2af3-ba86-58cd-b82f-f3924b3e7832 with identifier: GM59707
2026-01-28 17:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 184d2af3-ba86-58cd-b82f-f3924b3e7832 with identifier: GM59707 to the API
2026-01-28 17:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM59707>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:50:54Z',
 'fuel_type': 'petrol',
 'id': '184d2af3-ba86-58cd-b82f-f3924b3e7832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM59707',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 87,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2025}
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM59707%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Saving data for GM59707: {'auction_closing_time': 1769705454.0, 'created_time': 1769014829.295592, 'last_price_update_time': 1769619733.248876}
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GM59707') HTTP/1.1" 204 0
2026-01-28 17:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9988b81-9ad4-5057-8c45-c599913d905a with identifier: XR27466
2026-01-28 17:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9988b81-9ad4-5057-8c45-c599913d905a with identifier: XR27466
2026-01-28 17:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9988b81-9ad4-5057-8c45-c599913d905a with identifier: XR27466 to the API
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR27466>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-01-29T16:54:31Z',
 'fuel_type': 'petrol',
 'id': 'f9988b81-9ad4-5057-8c45-c599913d905a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR27466',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Mazda',
 'model': '6',
 'odometer': 129350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR27466%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Saving data for XR27466: {'auction_closing_time': 1769705671.0, 'created_time': 1769065280.084098, 'last_price_update_time': 1769619733.562755}
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR27466') HTTP/1.1" 204 0
2026-01-28 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_4acf85b4a48627f372728921941eacfe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: BU18758
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU18758%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for BU18758: 2
2026-01-28 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB75805> (referer: https://www.auto1.com/v1/car-details-view/BB75805/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR10719> (referer: https://www.auto1.com/v1/car-details-view/XR10719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP16982> (referer: https://www.auto1.com/v1/car-details-view/CP16982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: KY51908
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY51908%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for KY51908: 1
2026-01-28 17:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: NZ05021
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ05021%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for NZ05021: 0
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: RG84435
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG84435%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for RG84435: 0
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: ZW53743
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW53743%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for ZW53743: 2
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: ZN33203
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN33203%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for ZN33203: 0
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: EF10365
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF10365%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for EF10365: 2
2026-01-28 17:02:13 [auto1.es] INFO: Found listing with ID: SD03566
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD03566%27 HTTP/1.1" 200 None
2026-01-28 17:02:13 [auto1.es] INFO: Scrape type for SD03566: 2
2026-01-28 17:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a12890>
2026-01-28 17:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_4acf85b4a48627f372728921941eacfe.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_4acf85b4a48627f372728921941eacfe.jpg saved to cache
2026-01-28 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f51cbfb-2134-56fd-af15-23c5207369dd with identifier: BB75805
2026-01-28 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f51cbfb-2134-56fd-af15-23c5207369dd with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f51cbfb-2134-56fd-af15-23c5207369dd with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f51cbfb-2134-56fd-af15-23c5207369dd, identifier: BB75805
2026-01-28 17:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059abb93-b3f2-51a8-ad19-c1fb51883248 with identifier: XR10719
2026-01-28 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059abb93-b3f2-51a8-ad19-c1fb51883248 with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059abb93-b3f2-51a8-ad19-c1fb51883248 with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 059abb93-b3f2-51a8-ad19-c1fb51883248, identifier: XR10719
2026-01-28 17:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-01-28 17:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with scrape type 2
2026-01-28 17:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93, identifier: CP16982
2026-01-28 17:02:14 [auto1.es] INFO: Found listing with ID: YW79111
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW79111%27 HTTP/1.1" 200 None
2026-01-28 17:02:14 [auto1.es] INFO: Scrape type for YW79111: 2
2026-01-28 17:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f51cbfb-2134-56fd-af15-23c5207369dd with identifier: BB75805
2026-01-28 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f51cbfb-2134-56fd-af15-23c5207369dd with identifier: BB75805
2026-01-28 17:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f51cbfb-2134-56fd-af15-23c5207369dd with identifier: BB75805 to the API
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BB75805>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:54:00Z',
 'fuel_type': 'petrol',
 'id': '0f51cbfb-2134-56fd-af15-23c5207369dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB75805',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 128996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Tech',
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2019}
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB75805%27 HTTP/1.1" 200 None
2026-01-28 17:02:14 [auto1.es] INFO: Saving data for BB75805: {'auction_closing_time': 1769705640.0, 'created_time': 1769002798.971465, 'last_price_update_time': 1769619734.769501}
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB75805') HTTP/1.1" 204 0
2026-01-28 17:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 059abb93-b3f2-51a8-ad19-c1fb51883248 with identifier: XR10719
2026-01-28 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 059abb93-b3f2-51a8-ad19-c1fb51883248 with identifier: XR10719
2026-01-28 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
2026-01-28 17:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 059abb93-b3f2-51a8-ad19-c1fb51883248 spider: auto1.es
2026-01-28 17:02:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 059abb93-b3f2-51a8-ad19-c1fb51883248 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 't6 california' containing 'california'
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:46:30Z',
 'fuel_type': 'diesel',
 'id': '059abb93-b3f2-51a8-ad19-c1fb51883248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR10719',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 101871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Beach Camper FWD',
 'transmission': 'automatic',
 'trim': 'Beach Camper FWD',
 'year': 2021}
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR10719%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Saving data for XR10719: {'auction_closing_time': 1769705190.0, 'created_time': 1769519025.177811, 'last_price_update_time': 1769619735.096467}
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR10719') HTTP/1.1" 204 0
2026-01-28 17:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-01-28 17:02:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982
2026-01-28 17:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6af89766-7bfc-5c4b-a911-2bb2a61f1f93 with identifier: CP16982 to the API
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP16982>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 106,
 'expiration_date': '2026-01-29T16:02:39Z',
 'fuel_type': 'gas',
 'id': '6af89766-7bfc-5c4b-a911-2bb2a61f1f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP16982',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'EVO',
 'model': '4',
 'odometer': 28913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'EVO 4 1.6 LPG',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16982%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Saving data for CP16982: {'auction_closing_time': 1769702559.0, 'created_time': 1765951358.570132, 'last_price_update_time': 1769619735.665378}
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP16982') HTTP/1.1" 204 0
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: EB01783
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB01783%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for EB01783: 0
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: CC08164
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08164%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for CC08164: 1
2026-01-28 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV43271/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR74795> (referer: https://www.auto1.com/v1/car-details-view/YR74795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG84665> (referer: https://www.auto1.com/v1/car-details-view/FG84665/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF55204> (referer: https://www.auto1.com/v1/car-details-view/VF55204/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY29147> (referer: https://www.auto1.com/v1/car-details-view/MY29147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: FN28666
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN28666%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for FN28666: 2
2026-01-28 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: MU67506
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU67506%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for MU67506: 1
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: DS42714
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS42714%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for DS42714: 2
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: RN59031
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59031%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for RN59031: 2
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: PX23975
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX23975%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for PX23975: 0
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: FG34544
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG34544%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for FG34544: 0
2026-01-28 17:02:15 [auto1.es] INFO: Found listing with ID: BN00147
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN00147%27 HTTP/1.1" 200 None
2026-01-28 17:02:15 [auto1.es] INFO: Scrape type for BN00147: 1
2026-01-28 17:02:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe28d8b-2450-5671-b869-6773319ed008 with identifier: YR74795
2026-01-28 17:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe28d8b-2450-5671-b869-6773319ed008 with scrape type 2
2026-01-28 17:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe28d8b-2450-5671-b869-6773319ed008 with scrape type 2
2026-01-28 17:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cfe28d8b-2450-5671-b869-6773319ed008, identifier: YR74795
2026-01-28 17:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9476257d-8a47-5c67-8d73-0026f951ce8f with identifier: FG84665
2026-01-28 17:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9476257d-8a47-5c67-8d73-0026f951ce8f with scrape type 1
2026-01-28 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_0654deacb1810a8affcc68377a98fc30.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_0654deacb1810a8affcc68377a98fc30.jpg not downloaded yet
2026-01-28 17:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f4ed90-6b23-55c7-8e28-58cbb3431217 with identifier: VF55204
2026-01-28 17:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f4ed90-6b23-55c7-8e28-58cbb3431217 with scrape type 2
2026-01-28 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3f4ed90-6b23-55c7-8e28-58cbb3431217 with scrape type 2
2026-01-28 17:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d3f4ed90-6b23-55c7-8e28-58cbb3431217, identifier: VF55204
2026-01-28 17:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2026-01-28 17:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a476f0e2-54a0-5b2e-989e-2d96b48e475a with scrape type 2
2026-01-28 17:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a476f0e2-54a0-5b2e-989e-2d96b48e475a with scrape type 2
2026-01-28 17:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a476f0e2-54a0-5b2e-989e-2d96b48e475a, identifier: MY29147
2026-01-28 17:02:16 [auto1.es] INFO: Found listing with ID: XT61158
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT61158%27 HTTP/1.1" 200 None
2026-01-28 17:02:16 [auto1.es] INFO: Scrape type for XT61158: 0
2026-01-28 17:02:16 [auto1.es] INFO: Found listing with ID: XS28842
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS28842%27 HTTP/1.1" 200 None
2026-01-28 17:02:16 [auto1.es] INFO: Scrape type for XS28842: 2
2026-01-28 17:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cfe28d8b-2450-5671-b869-6773319ed008 with identifier: YR74795
2026-01-28 17:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cfe28d8b-2450-5671-b869-6773319ed008 with identifier: YR74795
2026-01-28 17:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cfe28d8b-2450-5671-b869-6773319ed008 with identifier: YR74795 to the API
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR74795>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:49:30Z',
 'fuel_type': 'petrol',
 'id': 'cfe28d8b-2450-5671-b869-6773319ed008',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR74795',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Citroen',
 'model': 'C-Elysée',
 'odometer': 67956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C-Elysée 1.2 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2019}
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR74795%27 HTTP/1.1" 200 None
2026-01-28 17:02:16 [auto1.es] INFO: Saving data for YR74795: {'auction_closing_time': 1769705370.0, 'created_time': 1769002774.472308, 'last_price_update_time': 1769619736.695999}
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR74795') HTTP/1.1" 204 0
2026-01-28 17:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d3f4ed90-6b23-55c7-8e28-58cbb3431217 with identifier: VF55204
2026-01-28 17:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d3f4ed90-6b23-55c7-8e28-58cbb3431217 with identifier: VF55204
2026-01-28 17:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d3f4ed90-6b23-55c7-8e28-58cbb3431217 with identifier: VF55204 to the API
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF55204>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:37:23Z',
 'fuel_type': 'diesel',
 'id': 'd3f4ed90-6b23-55c7-8e28-58cbb3431217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF55204',
 'listing': 'auction',
 'location': 'ES, PONTEVEDRA',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 117447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi X-Tech 2WD',
 'transmission': 'manual',
 'trim': 'X-Tech 2WD',
 'year': 2017}
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF55204%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Saving data for VF55204: {'auction_closing_time': 1769704643.0, 'created_time': 1769533258.261407, 'last_price_update_time': 1769619737.105284}
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF55204') HTTP/1.1" 204 0
2026-01-28 17:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2026-01-28 17:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147
2026-01-28 17:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a476f0e2-54a0-5b2e-989e-2d96b48e475a with identifier: MY29147 to the API
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MY29147>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:50:08Z',
 'fuel_type': 'petrol',
 'id': 'a476f0e2-54a0-5b2e-989e-2d96b48e475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY29147',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 65225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Ambiance 4x2',
 'transmission': 'manual',
 'trim': 'Ambiance 4x2',
 'year': 2017}
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MY29147%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Saving data for MY29147: {'auction_closing_time': 1769705408.0, 'created_time': 1769162592.507064, 'last_price_update_time': 1769619737.464541}
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MY29147') HTTP/1.1" 204 0
2026-01-28 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg not downloaded yet
2026-01-28 17:02:17 [auto1.es] INFO: Found listing with ID: GN29508
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN29508%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Scrape type for GN29508: 0
2026-01-28 17:02:17 [auto1.es] INFO: Found listing with ID: ZG02337
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG02337%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Scrape type for ZG02337: 2
2026-01-28 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg not downloaded yet
2026-01-28 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR72202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ87320/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:17 [auto1.es] INFO: Found listing with ID: SH61762
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH61762%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Scrape type for SH61762: 2
2026-01-28 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg not downloaded yet
2026-01-28 17:02:17 [auto1.es] INFO: Found listing with ID: EF96991
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF96991%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [auto1.es] INFO: Scrape type for EF96991: 2
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_caf08a885f8a8f18069b005974014e75.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_caf08a885f8a8f18069b005974014e75.jpg not downloaded yet
2026-01-28 17:02:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62957cd0>
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_62fa32b9bbe961821ed6861da526e98a.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg saved to cache
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: RG88899
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG88899%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for RG88899: 2
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_b372dc757c6eb591d7b52c2735e876c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b372dc757c6eb591d7b52c2735e876c9.jpg not downloaded yet
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_0654deacb1810a8affcc68377a98fc30.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: ST27973
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST27973%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for ST27973: 2
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_e1ce710d20b256e3345a1f18253bafab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e1ce710d20b256e3345a1f18253bafab.jpg not downloaded yet
2026-01-28 17:02:18 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: ZN88133
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN88133%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for ZN88133: 0
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: US72477
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US72477%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for US72477: 1
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg not downloaded yet
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: XE14806
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE14806%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for XE14806: 2
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: VX43785
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX43785%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for VX43785: 0
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: MS00021
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS00021%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for MS00021: 2
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_90417ea7c11976f13a311e0a075e35b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_90417ea7c11976f13a311e0a075e35b5.jpg not downloaded yet
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: MA69462
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA69462%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for MA69462: 2
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635cc190>
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_0654deacb1810a8affcc68377a98fc30.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_0654deacb1810a8affcc68377a98fc30.jpg saved to cache
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63427f50>
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg saved to cache
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_caf08a885f8a8f18069b005974014e75.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_6b06aa88f9393cf73677dfc0061afacb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_6b06aa88f9393cf73677dfc0061afacb.jpg not downloaded yet
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: YR71719
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR71719%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for YR71719: 0
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: XM73958
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM73958%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for XM73958: 0
2026-01-28 17:02:18 [auto1.es] INFO: Found listing with ID: WG12955
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12955%27 HTTP/1.1" 200 None
2026-01-28 17:02:18 [auto1.es] INFO: Scrape type for WG12955: 2
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM65680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ35846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT06855> (referer: https://www.auto1.com/v1/car-details-view/FT06855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB95025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_483666173ea7338db77dda2af02460cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_483666173ea7338db77dda2af02460cc.jpg not downloaded yet
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: KL05378
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL05378%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for KL05378: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: RH90347
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH90347%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for RH90347: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: GD31300
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD31300%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for GD31300: 2
2026-01-28 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg not downloaded yet
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: VV48377
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV48377%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for VV48377: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: HN40641
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HN40641%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for HN40641: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: SA36026
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA36026%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for SA36026: 2
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aeec90>
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_caf08a885f8a8f18069b005974014e75.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_caf08a885f8a8f18069b005974014e75.jpg saved to cache
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_04c5c335ea755f764073e4d045d771b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_04c5c335ea755f764073e4d045d771b6.jpg not downloaded yet
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: XU22328
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU22328%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for XU22328: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: SP20067
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SP20067%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for SP20067: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: YD01288
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD01288%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for YD01288: 0
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: VJ79904
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ79904%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for VJ79904: 2
2026-01-28 17:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94d07310-2bdc-5129-bf2b-4474109a105b with identifier: FT06855
2026-01-28 17:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94d07310-2bdc-5129-bf2b-4474109a105b with scrape type 2
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94d07310-2bdc-5129-bf2b-4474109a105b with scrape type 2
2026-01-28 17:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 94d07310-2bdc-5129-bf2b-4474109a105b, identifier: FT06855
2026-01-28 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_90417ea7c11976f13a311e0a075e35b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_6b06aa88f9393cf73677dfc0061afacb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_e985cf37154f5196ea9225db95197523.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e985cf37154f5196ea9225db95197523.jpg not downloaded yet
2026-01-28 17:02:19 [auto1.es] INFO: Found listing with ID: SA80278
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA80278%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Scrape type for SA80278: 2
2026-01-28 17:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 94d07310-2bdc-5129-bf2b-4474109a105b with identifier: FT06855
2026-01-28 17:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 94d07310-2bdc-5129-bf2b-4474109a105b with identifier: FT06855
2026-01-28 17:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 94d07310-2bdc-5129-bf2b-4474109a105b with identifier: FT06855 to the API
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FT06855>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:00:30Z',
 'fuel_type': 'petrol',
 'id': '94d07310-2bdc-5129-bf2b-4474109a105b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT06855',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 64533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru XV 2.0 Mild-Hybrid Executive Plus',
 'transmission': 'automatic',
 'trim': 'Executive Plus',
 'year': 2023}
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FT06855%27 HTTP/1.1" 200 None
2026-01-28 17:02:19 [auto1.es] INFO: Saving data for FT06855: {'auction_closing_time': 1769702430.0, 'created_time': 1769519028.8565, 'last_price_update_time': 1769619739.967789}
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FT06855') HTTP/1.1" 204 0
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg not downloaded yet
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: FD79630
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for FD79630: 2
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU18758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC08164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG86564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a640d0>
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_90417ea7c11976f13a311e0a075e35b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_90417ea7c11976f13a311e0a075e35b5.jpg saved to cache
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62841750>
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_6b06aa88f9393cf73677dfc0061afacb.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_6b06aa88f9393cf73677dfc0061afacb.jpg saved to cache
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_adad69d589a94ce8ee6730814636ccc9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_adad69d589a94ce8ee6730814636ccc9.jpg not downloaded yet
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: AJ32908
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ32908%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for AJ32908: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: RZ41545
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ41545%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for RZ41545: 2
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_04c5c335ea755f764073e4d045d771b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: UJ63738
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ63738%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for UJ63738: 2
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW53743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV84112/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: GU92487
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU92487%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for GU92487: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: TB61006
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB61006%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for TB61006: 2
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD03566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: CV22781
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV22781%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for CV22781: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: NZ48494
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ48494%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for NZ48494: 2
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF10365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: CF97208
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF97208%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for CF97208: 2
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: FH99836
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH99836%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for FH99836: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: JA64346
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JA64346%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for JA64346: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: AR73253
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR73253%27 HTTP/1.1" 200 None
2026-01-28 17:02:20 [auto1.es] INFO: Scrape type for AR73253: 0
2026-01-28 17:02:20 [auto1.es] INFO: Found listing with ID: DS37316
2026-01-28 17:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS37316%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for DS37316: 2
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a12a50>
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_04c5c335ea755f764073e4d045d771b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_04c5c335ea755f764073e4d045d771b6.jpg saved to cache
2026-01-28 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: GR77788
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR77788%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for GR77788: 2
2026-01-28 17:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e985cf37154f5196ea9225db95197523.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: WJ42135
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ42135%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for WJ42135: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: KW77045
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW77045%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for KW77045: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: NY35740
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for NY35740: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: ZC41247
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC41247%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for ZC41247: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: DJ65023
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ65023%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for DJ65023: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: TV18769
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV18769%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for TV18769: 0
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: BX04105
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX04105%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for BX04105: 2
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62932290>
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_e985cf37154f5196ea9225db95197523.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e985cf37154f5196ea9225db95197523.jpg saved to cache
2026-01-28 17:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: ZR62328
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR62328%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for ZR62328: 2
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: DU80277
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DU80277%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for DU80277: 0
2026-01-28 17:02:21 [auto1.es] INFO: Found listing with ID: ZJ66849
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZJ66849%27 HTTP/1.1" 200 None
2026-01-28 17:02:21 [auto1.es] INFO: Scrape type for ZJ66849: 0
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG12955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XS28842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA69462/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ79904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS00021/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW79111/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG02337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA80278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ41545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD79630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC08164> (referer: https://www.auto1.com/v1/car-details-view/CC08164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG86564> (referer: https://www.auto1.com/v1/car-details-view/VG86564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB61006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bda27f4e-a399-583e-9196-825b56d2ee83 with identifier: CC08164
2026-01-28 17:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bda27f4e-a399-583e-9196-825b56d2ee83 with scrape type 1
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item bda27f4e-a399-583e-9196-825b56d2ee83
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_edbddc7613e76b8959db76a798519053.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_edbddc7613e76b8959db76a798519053.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_98a6b953233e3e9d5490dcaa8fe85e07.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_98a6b953233e3e9d5490dcaa8fe85e07.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_fabfb69c043e92b27cc51126200e4e5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_fabfb69c043e92b27cc51126200e4e5e.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_682abe9b1ed186c8b4fca36879bfa68a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_682abe9b1ed186c8b4fca36879bfa68a.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_666430ab80270a5b0cea5ecad5fa9431.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_666430ab80270a5b0cea5ecad5fa9431.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_0cde01cec79bbfdfeb5c353aa6208d07.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_0cde01cec79bbfdfeb5c353aa6208d07.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_ba8786d531533c754c2621e6d2059185.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_ba8786d531533c754c2621e6d2059185.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_16656ceed95aa3ff865ca9e1e2c4f7c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_16656ceed95aa3ff865ca9e1e2c4f7c6.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_686512fc686516a3b63ef699c66c1bdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_686512fc686516a3b63ef699c66c1bdd.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_5ad8a569aea3b6afa1959086abb8bac2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5ad8a569aea3b6afa1959086abb8bac2.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_5cc34eb685d015a8f6544956c6e23b17.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5cc34eb685d015a8f6544956c6e23b17.jpg already downloaded
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fd9%252F45d9a28326d844d1ab4fcae2b7b6c4b9%252Fpa%252FCC08164_4f53a3aa4f11f109c8d09d95289532a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_4f53a3aa4f11f109c8d09d95289532a8.jpg already downloaded
2026-01-28 17:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bda27f4e-a399-583e-9196-825b56d2ee83, identifier: CC08164
2026-01-28 17:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bda27f4e-a399-583e-9196-825b56d2ee83 with identifier: CC08164
2026-01-28 17:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bda27f4e-a399-583e-9196-825b56d2ee83 with identifier: CC08164
2026-01-28 17:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bda27f4e-a399-583e-9196-825b56d2ee83 with identifier: CC08164 to the API
2026-01-28 17:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC08164>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:09:18Z',
 'fuel_type': 'petrol',
 'id': 'bda27f4e-a399-583e-9196-825b56d2ee83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC08164',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 29225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_edbddc7613e76b8959db76a798519053.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_98a6b953233e3e9d5490dcaa8fe85e07.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_fabfb69c043e92b27cc51126200e4e5e.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_682abe9b1ed186c8b4fca36879bfa68a.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_666430ab80270a5b0cea5ecad5fa9431.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_0cde01cec79bbfdfeb5c353aa6208d07.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_ba8786d531533c754c2621e6d2059185.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_16656ceed95aa3ff865ca9e1e2c4f7c6.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_686512fc686516a3b63ef699c66c1bdd.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5ad8a569aea3b6afa1959086abb8bac2.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5cc34eb685d015a8f6544956c6e23b17.jpg',
                'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_4f53a3aa4f11f109c8d09d95289532a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_edbddc7613e76b8959db76a798519053.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_98a6b953233e3e9d5490dcaa8fe85e07.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_fabfb69c043e92b27cc51126200e4e5e.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_682abe9b1ed186c8b4fca36879bfa68a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_666430ab80270a5b0cea5ecad5fa9431.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_0cde01cec79bbfdfeb5c353aa6208d07.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 395896,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_ba8786d531533c754c2621e6d2059185.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78663,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_16656ceed95aa3ff865ca9e1e2c4f7c6.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_686512fc686516a3b63ef699c66c1bdd.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5ad8a569aea3b6afa1959086abb8bac2.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_5cc34eb685d015a8f6544956c6e23b17.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bda27f4e-a399-583e-9196-825b56d2ee83/bda27f4e-a399-583e-9196-825b56d2ee83_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/d9/45d9a28326d844d1ab4fcae2b7b6c4b9/pa/CC08164_4f53a3aa4f11f109c8d09d95289532a8.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2023}
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC08164%27 HTTP/1.1" 200 None
2026-01-28 17:02:24 [auto1.es] INFO: Saving data for CC08164: {'created_time': 1769619744.172641, 'last_price_update_time': 1769619744.172651, 'auction_closing_time': 1769702958.0}
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC08164') HTTP/1.1" 204 0
2026-01-28 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS37316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR62328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG88899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX04105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU18758> (referer: https://www.auto1.com/v1/car-details-view/BU18758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 919e329b-db1c-5a93-b859-f5f82f60d304 with identifier: VG86564
2026-01-28 17:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 919e329b-db1c-5a93-b859-f5f82f60d304 with scrape type 2
2026-01-28 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 919e329b-db1c-5a93-b859-f5f82f60d304 with scrape type 2
2026-01-28 17:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 919e329b-db1c-5a93-b859-f5f82f60d304, identifier: VG86564
2026-01-28 17:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 919e329b-db1c-5a93-b859-f5f82f60d304 with identifier: VG86564
2026-01-28 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 919e329b-db1c-5a93-b859-f5f82f60d304 with identifier: VG86564
2026-01-28 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195938 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195938
2026-01-28 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 919e329b-db1c-5a93-b859-f5f82f60d304 spider: auto1.es
2026-01-28 17:02:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 919e329b-db1c-5a93-b859-f5f82f60d304 due to rule: high_mileage_for_country.json, error: 195938 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195938
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:50:59Z',
 'fuel_type': 'gas',
 'id': '919e329b-db1c-5a93-b859-f5f82f60d304',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG86564',
 'listing': 'auction',
 'location': 'ES, Leganés',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 195938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 LPG Design Line',
 'transmission': 'manual',
 'trim': 'Design Line',
 'year': 2018}
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG86564%27 HTTP/1.1" 200 None
2026-01-28 17:02:24 [auto1.es] INFO: Saving data for VG86564: {'auction_closing_time': 1769705459.0, 'created_time': 1769518774.193825, 'last_price_update_time': 1769619744.599243}
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG86564') HTTP/1.1" 204 0
2026-01-28 17:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1f51dc3-b18b-53ba-911a-d008b4c0129d with identifier: BU18758
2026-01-28 17:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1f51dc3-b18b-53ba-911a-d008b4c0129d with scrape type 2
2026-01-28 17:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1f51dc3-b18b-53ba-911a-d008b4c0129d with scrape type 2
2026-01-28 17:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a1f51dc3-b18b-53ba-911a-d008b4c0129d, identifier: BU18758
2026-01-28 17:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a1f51dc3-b18b-53ba-911a-d008b4c0129d with identifier: BU18758
2026-01-28 17:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a1f51dc3-b18b-53ba-911a-d008b4c0129d with identifier: BU18758
2026-01-28 17:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a1f51dc3-b18b-53ba-911a-d008b4c0129d with identifier: BU18758 to the API
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU18758>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 252,
 'expiration_date': '2026-01-29T16:48:02Z',
 'fuel_type': 'petrol',
 'id': 'a1f51dc3-b18b-53ba-911a-d008b4c0129d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU18758',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 67047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU18758%27 HTTP/1.1" 200 None
2026-01-28 17:02:25 [auto1.es] INFO: Saving data for BU18758: {'auction_closing_time': 1769705282.0, 'created_time': 1769533285.265787, 'last_price_update_time': 1769619745.020238}
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU18758') HTTP/1.1" 204 0
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ65023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC41247/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG12955> (referer: https://www.auto1.com/v1/car-details-view/WG12955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6907b6a0-3898-5cdb-a895-d81669aa164f with identifier: WG12955
2026-01-28 17:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6907b6a0-3898-5cdb-a895-d81669aa164f with scrape type 2
2026-01-28 17:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6907b6a0-3898-5cdb-a895-d81669aa164f with scrape type 2
2026-01-28 17:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6907b6a0-3898-5cdb-a895-d81669aa164f, identifier: WG12955
2026-01-28 17:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6907b6a0-3898-5cdb-a895-d81669aa164f with identifier: WG12955
2026-01-28 17:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6907b6a0-3898-5cdb-a895-d81669aa164f with identifier: WG12955
2026-01-28 17:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6907b6a0-3898-5cdb-a895-d81669aa164f with identifier: WG12955 to the API
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG12955>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:02:05Z',
 'fuel_type': 'petrol',
 'id': '6907b6a0-3898-5cdb-a895-d81669aa164f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG12955',
 'listing': 'auction',
 'location': 'ES, MÁLAGA',
 'make': 'Mazda',
 'model': '3',
 'odometer': 44831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Comfort+',
 'transmission': 'manual',
 'trim': 'Comfort+',
 'year': 2020}
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG12955%27 HTTP/1.1" 200 None
2026-01-28 17:02:25 [auto1.es] INFO: Saving data for WG12955: {'auction_closing_time': 1769702525.0, 'created_time': 1769518953.494536, 'last_price_update_time': 1769619745.928072}
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG12955') HTTP/1.1" 204 0
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW79111> (referer: https://www.auto1.com/v1/car-details-view/YW79111/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA69462> (referer: https://www.auto1.com/v1/car-details-view/MA69462/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XS28842> (referer: https://www.auto1.com/v1/car-details-view/XS28842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5e5f2b-4e05-5c3a-882f-e15980d75342 with identifier: YW79111
2026-01-28 17:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5e5f2b-4e05-5c3a-882f-e15980d75342 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5e5f2b-4e05-5c3a-882f-e15980d75342 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b5e5f2b-4e05-5c3a-882f-e15980d75342, identifier: YW79111
2026-01-28 17:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad853a29-a6f9-5262-96f3-992334d49513 with identifier: MA69462
2026-01-28 17:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad853a29-a6f9-5262-96f3-992334d49513 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad853a29-a6f9-5262-96f3-992334d49513 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad853a29-a6f9-5262-96f3-992334d49513, identifier: MA69462
2026-01-28 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b5e5f2b-4e05-5c3a-882f-e15980d75342 with identifier: YW79111
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b5e5f2b-4e05-5c3a-882f-e15980d75342 with identifier: YW79111
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7b5e5f2b-4e05-5c3a-882f-e15980d75342 spider: auto1.es
2026-01-28 17:02:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7b5e5f2b-4e05-5c3a-882f-e15980d75342 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:47:16Z',
 'fuel_type': 'diesel',
 'id': '7b5e5f2b-4e05-5c3a-882f-e15980d75342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW79111',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 124777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Furgón',
 'transmission': 'manual',
 'trim': 'Furgón',
 'year': 2021}
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW79111%27 HTTP/1.1" 200 None
2026-01-28 17:02:26 [auto1.es] INFO: Saving data for YW79111: {'auction_closing_time': 1769705236.0, 'created_time': 1769061713.344509, 'last_price_update_time': 1769619746.453018}
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YW79111') HTTP/1.1" 204 0
2026-01-28 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad853a29-a6f9-5262-96f3-992334d49513 with identifier: MA69462
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad853a29-a6f9-5262-96f3-992334d49513 with identifier: MA69462
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 119353, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma69462', 'expiration_date': '2026-01-29t16:24:53z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ad853a29-a6f9-5262-96f3-992334d49513', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 119353}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:24:53z',
     'fuel_type': 'petrol',
     'id': 'ad853a29-a6f9-5262-96f3-992334d49513',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma69462',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 119353,
     'odometer_in_km': 119353,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-23',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ad853a29-a6f9-5262-96f3-992334d49513 spider: auto1.es
2026-01-28 17:02:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ad853a29-a6f9-5262-96f3-992334d49513 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech shine', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 119353, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma69462', 'expiration_date': '2026-01-29t16:24:53z', 'origin_country_code': 'es', 'trim': 'shine', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, araia', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': 'ad853a29-a6f9-5262-96f3-992334d49513', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 119353}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:24:53z',
     'fuel_type': 'petrol',
     'id': 'ad853a29-a6f9-5262-96f3-992334d49513',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma69462',
     'listing': 'auction',
     'location': 'es, araia',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 119353,
     'odometer_in_km': 119353,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-23',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech shine',
     'transmission': 'manual',
     'trim': 'shine',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:24:53Z',
 'fuel_type': 'petrol',
 'id': 'ad853a29-a6f9-5262-96f3-992334d49513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA69462',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 119353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA69462%27 HTTP/1.1" 200 None
2026-01-28 17:02:26 [auto1.es] INFO: Saving data for MA69462: {'auction_closing_time': 1769703893.0, 'created_time': 1768496652.487695, 'last_price_update_time': 1769619746.67189}
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA69462') HTTP/1.1" 204 0
2026-01-28 17:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 788d74d2-859e-5094-9793-af8f1e59fac2 with identifier: XS28842
2026-01-28 17:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 788d74d2-859e-5094-9793-af8f1e59fac2 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 788d74d2-859e-5094-9793-af8f1e59fac2 with scrape type 2
2026-01-28 17:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 788d74d2-859e-5094-9793-af8f1e59fac2, identifier: XS28842
2026-01-28 17:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ41545> (referer: https://www.auto1.com/v1/car-details-view/RZ41545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 788d74d2-859e-5094-9793-af8f1e59fac2 with identifier: XS28842
2026-01-28 17:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 788d74d2-859e-5094-9793-af8f1e59fac2 with identifier: XS28842
2026-01-28 17:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 788d74d2-859e-5094-9793-af8f1e59fac2 with identifier: XS28842 to the API
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XS28842>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:24:15Z',
 'fuel_type': 'petrol',
 'id': '788d74d2-859e-5094-9793-af8f1e59fac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS28842',
 'listing': 'auction',
 'location': 'ES, Manresa',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 88949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Drive 2WD',
 'transmission': 'manual',
 'trim': 'Drive 2WD',
 'year': 2018}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XS28842%27 HTTP/1.1" 200 None
2026-01-28 17:02:27 [auto1.es] INFO: Saving data for XS28842: {'auction_closing_time': 1769703855.0, 'created_time': 1769518734.059289, 'last_price_update_time': 1769619747.100045}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XS28842') HTTP/1.1" 204 0
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD79630> (referer: https://www.auto1.com/v1/car-details-view/FD79630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f580dc53-a1ec-50c2-a9cd-941992b14a45 with identifier: RZ41545
2026-01-28 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f580dc53-a1ec-50c2-a9cd-941992b14a45 with scrape type 2
2026-01-28 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f580dc53-a1ec-50c2-a9cd-941992b14a45 with scrape type 2
2026-01-28 17:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f580dc53-a1ec-50c2-a9cd-941992b14a45, identifier: RZ41545
2026-01-28 17:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f580dc53-a1ec-50c2-a9cd-941992b14a45 with identifier: RZ41545
2026-01-28 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f580dc53-a1ec-50c2-a9cd-941992b14a45 with identifier: RZ41545
2026-01-28 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f580dc53-a1ec-50c2-a9cd-941992b14a45 spider: auto1.es
2026-01-28 17:02:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f580dc53-a1ec-50c2-a9cd-941992b14a45 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:40:44Z',
 'fuel_type': 'diesel',
 'id': 'f580dc53-a1ec-50c2-a9cd-941992b14a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ41545',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 121872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-17',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2021}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ41545%27 HTTP/1.1" 200 None
2026-01-28 17:02:27 [auto1.es] INFO: Saving data for RZ41545: {'auction_closing_time': 1769704844.0, 'created_time': 1769421909.162225, 'last_price_update_time': 1769619747.423491}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ41545') HTTP/1.1" 204 0
2026-01-28 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA80278> (referer: https://www.auto1.com/v1/car-details-view/SA80278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 850df64d-f692-5dfc-ace5-8160ef93e001 with identifier: FD79630
2026-01-28 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 850df64d-f692-5dfc-ace5-8160ef93e001 with scrape type 2
2026-01-28 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 850df64d-f692-5dfc-ace5-8160ef93e001 with scrape type 2
2026-01-28 17:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 850df64d-f692-5dfc-ace5-8160ef93e001, identifier: FD79630
2026-01-28 17:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 850df64d-f692-5dfc-ace5-8160ef93e001 with identifier: FD79630
2026-01-28 17:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 850df64d-f692-5dfc-ace5-8160ef93e001 with identifier: FD79630
2026-01-28 17:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 850df64d-f692-5dfc-ace5-8160ef93e001 with identifier: FD79630 to the API
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD79630>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:09:39Z',
 'fuel_type': 'diesel',
 'id': '850df64d-f692-5dfc-ace5-8160ef93e001',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD79630',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 116478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FD79630%27 HTTP/1.1" 200 None
2026-01-28 17:02:27 [auto1.es] INFO: Saving data for FD79630: {'auction_closing_time': 1769702979.0, 'created_time': 1769421749.714178, 'last_price_update_time': 1769619747.912718}
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FD79630') HTTP/1.1" 204 0
2026-01-28 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW77045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY35740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ79904> (referer: https://www.auto1.com/v1/car-details-view/VJ79904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with identifier: SA80278
2026-01-28 17:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with scrape type 2
2026-01-28 17:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f, identifier: SA80278
2026-01-28 17:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with identifier: SA80278
2026-01-28 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with identifier: SA80278
2026-01-28 17:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f with identifier: SA80278 to the API
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SA80278>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:47:53Z',
 'fuel_type': 'petrol',
 'id': 'f2bb49ed-0b2d-5343-9c36-a10fc2f03e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA80278',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 133978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Concept 2WD',
 'transmission': 'manual',
 'trim': 'Concept 2WD',
 'year': 2017}
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA80278%27 HTTP/1.1" 200 None
2026-01-28 17:02:28 [auto1.es] INFO: Saving data for SA80278: {'auction_closing_time': 1769705273.0, 'created_time': 1769003361.425452, 'last_price_update_time': 1769619748.363744}
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA80278') HTTP/1.1" 204 0
2026-01-28 17:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG02337> (referer: https://www.auto1.com/v1/car-details-view/ZG02337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS00021> (referer: https://www.auto1.com/v1/car-details-view/MS00021/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b354b3-5702-5ccb-8ffb-144045d85965 with identifier: VJ79904
2026-01-28 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b354b3-5702-5ccb-8ffb-144045d85965 with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36b354b3-5702-5ccb-8ffb-144045d85965 with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36b354b3-5702-5ccb-8ffb-144045d85965, identifier: VJ79904
2026-01-28 17:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36b354b3-5702-5ccb-8ffb-144045d85965 with identifier: VJ79904
2026-01-28 17:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36b354b3-5702-5ccb-8ffb-144045d85965 with identifier: VJ79904
2026-01-28 17:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 36b354b3-5702-5ccb-8ffb-144045d85965 with identifier: VJ79904 to the API
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VJ79904>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:12:40Z',
 'fuel_type': 'petrol',
 'id': '36b354b3-5702-5ccb-8ffb-144045d85965',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ79904',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 62830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VJ79904%27 HTTP/1.1" 200 None
2026-01-28 17:02:28 [auto1.es] INFO: Saving data for VJ79904: {'auction_closing_time': 1769703160.0, 'created_time': 1768912872.313594, 'last_price_update_time': 1769619748.788995}
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VJ79904') HTTP/1.1" 204 0
2026-01-28 17:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD03566> (referer: https://www.auto1.com/v1/car-details-view/SD03566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3fad0d-7378-5b68-a887-37c5e72bb246 with identifier: ZG02337
2026-01-28 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3fad0d-7378-5b68-a887-37c5e72bb246 with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c3fad0d-7378-5b68-a887-37c5e72bb246 with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c3fad0d-7378-5b68-a887-37c5e72bb246, identifier: ZG02337
2026-01-28 17:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b with identifier: MS00021
2026-01-28 17:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b with scrape type 2
2026-01-28 17:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b with scrape type 2
2026-01-28 17:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b, identifier: MS00021
2026-01-28 17:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c3fad0d-7378-5b68-a887-37c5e72bb246 with identifier: ZG02337
2026-01-28 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c3fad0d-7378-5b68-a887-37c5e72bb246 with identifier: ZG02337
2026-01-28 17:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3c3fad0d-7378-5b68-a887-37c5e72bb246 with identifier: ZG02337 to the API
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZG02337>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:56:54Z',
 'fuel_type': 'petrol',
 'id': '3c3fad0d-7378-5b68-a887-37c5e72bb246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG02337',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 115341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG02337%27 HTTP/1.1" 200 None
2026-01-28 17:02:29 [auto1.es] INFO: Saving data for ZG02337: {'auction_closing_time': 1769705814.0, 'created_time': 1769101715.864126, 'last_price_update_time': 1769619749.323949}
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG02337') HTTP/1.1" 204 0
2026-01-28 17:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b with identifier: MS00021
2026-01-28 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b with identifier: MS00021
2026-01-28 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
2026-01-28 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b spider: auto1.es
2026-01-28 17:02:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:56:22Z',
 'fuel_type': 'petrol',
 'id': '6df0c5f7-813d-5b1a-bc3c-43d9d0966d4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS00021',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 35426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.3 TCe SL Xplore',
 'transmission': 'manual',
 'trim': 'SL Xplore',
 'year': 2019}
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MS00021%27 HTTP/1.1" 200 None
2026-01-28 17:02:29 [auto1.es] INFO: Saving data for MS00021: {'auction_closing_time': 1769705782.0, 'created_time': 1769061769.94358, 'last_price_update_time': 1769619749.55854}
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MS00021') HTTP/1.1" 204 0
2026-01-28 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC41247> (referer: https://www.auto1.com/v1/car-details-view/ZC41247/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX04105> (referer: https://www.auto1.com/v1/car-details-view/BX04105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF10365> (referer: https://www.auto1.com/v1/car-details-view/EF10365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with identifier: SD03566
2026-01-28 17:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with scrape type 2
2026-01-28 17:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with scrape type 2
2026-01-28 17:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7864dd0-dac0-534f-8aa4-1b4e7ed4890b, identifier: SD03566
2026-01-28 17:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with identifier: SD03566
2026-01-28 17:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with identifier: SD03566
2026-01-28 17:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7864dd0-dac0-534f-8aa4-1b4e7ed4890b with identifier: SD03566 to the API
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD03566>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:46:19Z',
 'fuel_type': 'petrol',
 'id': 'd7864dd0-dac0-534f-8aa4-1b4e7ed4890b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD03566',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 80757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2022}
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD03566%27 HTTP/1.1" 200 None
2026-01-28 17:02:29 [auto1.es] INFO: Saving data for SD03566: {'auction_closing_time': 1769705179.0, 'created_time': 1769519025.961211, 'last_price_update_time': 1769619749.997248}
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SD03566') HTTP/1.1" 204 0
2026-01-28 17:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a6cb61f-da77-58c0-9d4a-10d04597339e with identifier: ZC41247
2026-01-28 17:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a6cb61f-da77-58c0-9d4a-10d04597339e with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a6cb61f-da77-58c0-9d4a-10d04597339e with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7a6cb61f-da77-58c0-9d4a-10d04597339e, identifier: ZC41247
2026-01-28 17:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with identifier: BX04105
2026-01-28 17:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 88f48921-ac6c-5e09-9d29-ffe2d4b56741, identifier: BX04105
2026-01-28 17:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with identifier: EF10365
2026-01-28 17:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with scrape type 2
2026-01-28 17:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b0ddc2cc-7a22-5f66-8809-f1bd3ee26340, identifier: EF10365
2026-01-28 17:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7a6cb61f-da77-58c0-9d4a-10d04597339e with identifier: ZC41247
2026-01-28 17:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7a6cb61f-da77-58c0-9d4a-10d04597339e with identifier: ZC41247
2026-01-28 17:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7a6cb61f-da77-58c0-9d4a-10d04597339e with identifier: ZC41247 to the API
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC41247>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:36:55Z',
 'fuel_type': 'petrol',
 'id': '7a6cb61f-da77-58c0-9d4a-10d04597339e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC41247',
 'listing': 'auction',
 'location': 'Móstoles',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 41140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Reference Plus',
 'transmission': 'manual',
 'trim': 'Reference Plus',
 'year': 2017}
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC41247%27 HTTP/1.1" 200 None
2026-01-28 17:02:30 [auto1.es] INFO: Saving data for ZC41247: {'auction_closing_time': 1769704615.0, 'created_time': 1769518633.357512, 'last_price_update_time': 1769619750.608693}
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC41247') HTTP/1.1" 204 0
2026-01-28 17:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with identifier: BX04105
2026-01-28 17:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with identifier: BX04105
2026-01-28 17:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 88f48921-ac6c-5e09-9d29-ffe2d4b56741 with identifier: BX04105 to the API
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX04105>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:50:59Z',
 'fuel_type': 'petrol',
 'id': '88f48921-ac6c-5e09-9d29-ffe2d4b56741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX04105',
 'listing': 'auction',
 'location': 'ES, Tudela',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 69813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2021}
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX04105%27 HTTP/1.1" 200 None
2026-01-28 17:02:30 [auto1.es] INFO: Saving data for BX04105: {'auction_closing_time': 1769705459.0, 'created_time': 1769518730.949178, 'last_price_update_time': 1769619750.935776}
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX04105') HTTP/1.1" 204 0
2026-01-28 17:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with identifier: EF10365
2026-01-28 17:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-01-28 17:02:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with identifier: EF10365
2026-01-28 17:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b0ddc2cc-7a22-5f66-8809-f1bd3ee26340 with identifier: EF10365 to the API
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF10365>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:24:00Z',
 'fuel_type': 'petrol',
 'id': 'b0ddc2cc-7a22-5f66-8809-f1bd3ee26340',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF10365',
 'listing': 'auction',
 'location': 'ES, Manacor',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 94983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Prestige 4x4',
 'transmission': 'manual',
 'trim': 'Prestige 4x4',
 'year': 2019}
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF10365%27 HTTP/1.1" 200 None
2026-01-28 17:02:31 [auto1.es] INFO: Saving data for EF10365: {'auction_closing_time': 1769703840.0, 'created_time': 1769519742.292796, 'last_price_update_time': 1769619751.70901}
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF10365') HTTP/1.1" 204 0
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG88899> (referer: https://www.auto1.com/v1/car-details-view/RG88899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_adad69d589a94ce8ee6730814636ccc9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB61006> (referer: https://www.auto1.com/v1/car-details-view/TB61006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR62328> (referer: https://www.auto1.com/v1/car-details-view/ZR62328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS37316> (referer: https://www.auto1.com/v1/car-details-view/DS37316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ65023> (referer: https://www.auto1.com/v1/car-details-view/DJ65023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c43a1b-9110-5354-ae3f-b34602010121 with identifier: RG88899
2026-01-28 17:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c43a1b-9110-5354-ae3f-b34602010121 with scrape type 2
2026-01-28 17:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40c43a1b-9110-5354-ae3f-b34602010121 with scrape type 2
2026-01-28 17:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 40c43a1b-9110-5354-ae3f-b34602010121, identifier: RG88899
2026-01-28 17:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 40c43a1b-9110-5354-ae3f-b34602010121 with identifier: RG88899
2026-01-28 17:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 40c43a1b-9110-5354-ae3f-b34602010121 with identifier: RG88899
2026-01-28 17:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 40c43a1b-9110-5354-ae3f-b34602010121 with identifier: RG88899 to the API
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RG88899>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:31:45Z',
 'fuel_type': 'petrol',
 'id': '40c43a1b-9110-5354-ae3f-b34602010121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG88899',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 19195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RG88899%27 HTTP/1.1" 200 None
2026-01-28 17:02:32 [auto1.es] INFO: Saving data for RG88899: {'auction_closing_time': 1769704305.0, 'created_time': 1768669256.469438, 'last_price_update_time': 1769619752.247209}
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RG88899') HTTP/1.1" 204 0
2026-01-28 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_483666173ea7338db77dda2af02460cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a45ad0>
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_adad69d589a94ce8ee6730814636ccc9.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_adad69d589a94ce8ee6730814636ccc9.jpg saved to cache
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291a450>
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg saved to cache
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81da76eb-ce05-54dd-b550-d56acccf3332 with identifier: TB61006
2026-01-28 17:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81da76eb-ce05-54dd-b550-d56acccf3332 with scrape type 2
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81da76eb-ce05-54dd-b550-d56acccf3332 with scrape type 2
2026-01-28 17:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 81da76eb-ce05-54dd-b550-d56acccf3332, identifier: TB61006
2026-01-28 17:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with identifier: ZR62328
2026-01-28 17:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with scrape type 2
2026-01-28 17:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with scrape type 2
2026-01-28 17:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca7a36d5-526e-5ce5-b4d2-4adcb43355d0, identifier: ZR62328
2026-01-28 17:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with identifier: DS37316
2026-01-28 17:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with scrape type 2
2026-01-28 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with scrape type 2
2026-01-28 17:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9, identifier: DS37316
2026-01-28 17:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with identifier: DJ65023
2026-01-28 17:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with scrape type 2
2026-01-28 17:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with scrape type 2
2026-01-28 17:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee, identifier: DJ65023
2026-01-28 17:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 81da76eb-ce05-54dd-b550-d56acccf3332 with identifier: TB61006
2026-01-28 17:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 81da76eb-ce05-54dd-b550-d56acccf3332 with identifier: TB61006
2026-01-28 17:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 81da76eb-ce05-54dd-b550-d56acccf3332 with identifier: TB61006 to the API
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB61006>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-01-29T16:00:20Z',
 'fuel_type': 'petrol',
 'id': '81da76eb-ce05-54dd-b550-d56acccf3332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB61006',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 72722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2018}
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB61006%27 HTTP/1.1" 200 None
2026-01-28 17:02:33 [auto1.es] INFO: Saving data for TB61006: {'auction_closing_time': 1769702420.0, 'created_time': 1768237680.448103, 'last_price_update_time': 1769619753.582554}
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB61006') HTTP/1.1" 204 0
2026-01-28 17:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with identifier: ZR62328
2026-01-28 17:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with identifier: ZR62328
2026-01-28 17:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ca7a36d5-526e-5ce5-b4d2-4adcb43355d0 with identifier: ZR62328 to the API
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZR62328>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:07:01Z',
 'fuel_type': 'petrol',
 'id': 'ca7a36d5-526e-5ce5-b4d2-4adcb43355d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR62328',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 26755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'automatic',
 'trim': 'Monte Carlo',
 'year': 2024}
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZR62328%27 HTTP/1.1" 200 None
2026-01-28 17:02:33 [auto1.es] INFO: Saving data for ZR62328: {'auction_closing_time': 1769702821.0, 'created_time': 1769518758.371337, 'last_price_update_time': 1769619753.879625}
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZR62328') HTTP/1.1" 204 0
2026-01-28 17:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with identifier: DS37316
2026-01-28 17:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with identifier: DS37316
2026-01-28 17:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3166fe1f-d172-5d2a-b1de-5b736fa4c6e9 with identifier: DS37316 to the API
2026-01-28 17:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS37316>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:20:57Z',
 'fuel_type': 'petrol',
 'id': '3166fe1f-d172-5d2a-b1de-5b736fa4c6e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS37316',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 67785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2020}
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS37316%27 HTTP/1.1" 200 None
2026-01-28 17:02:34 [auto1.es] INFO: Saving data for DS37316: {'auction_closing_time': 1769703657.0, 'created_time': 1767185284.447367, 'last_price_update_time': 1769619754.206941}
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS37316') HTTP/1.1" 204 0
2026-01-28 17:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with identifier: DJ65023
2026-01-28 17:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with identifier: DJ65023
2026-01-28 17:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d14afcd-17f2-5a0c-afa4-a4dca552f7ee with identifier: DJ65023 to the API
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ65023>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:25:13Z',
 'fuel_type': 'petrol',
 'id': '9d14afcd-17f2-5a0c-afa4-a4dca552f7ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ65023',
 'listing': 'auction',
 'location': 'ES, Finestrat, Alicante',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 37451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Comfort',
 'transmission': 'manual',
 'trim': 'Stepway Comfort',
 'year': 2018}
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ65023%27 HTTP/1.1" 200 None
2026-01-28 17:02:34 [auto1.es] INFO: Saving data for DJ65023: {'auction_closing_time': 1769703913.0, 'created_time': 1769519606.37831, 'last_price_update_time': 1769619754.519093}
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DJ65023') HTTP/1.1" 204 0
2026-01-28 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW53743> (referer: https://www.auto1.com/v1/car-details-view/ZW53743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ42135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV84112> (referer: https://www.auto1.com/v1/car-details-view/TV84112/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63474190>
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_483666173ea7338db77dda2af02460cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_483666173ea7338db77dda2af02460cc.jpg saved to cache
2026-01-28 17:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6345e4d0>
2026-01-28 17:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg saved to cache
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e1c829-2b38-57ff-949a-fea82149f73b with identifier: ZW53743
2026-01-28 17:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e1c829-2b38-57ff-949a-fea82149f73b with scrape type 2
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e1c829-2b38-57ff-949a-fea82149f73b with scrape type 2
2026-01-28 17:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 27e1c829-2b38-57ff-949a-fea82149f73b, identifier: ZW53743
2026-01-28 17:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 with identifier: TV84112
2026-01-28 17:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 with scrape type 1
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_db51d67cd6745a6490a9cea613ce3cdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_db51d67cd6745a6490a9cea613ce3cdc.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_1ad1b2db8e3bc24cd495f9fe38af2612.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1ad1b2db8e3bc24cd495f9fe38af2612.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_da75f70d674e824ef077fe51009cb5f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_da75f70d674e824ef077fe51009cb5f5.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_6867373344789495e78bf083abb5807f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_6867373344789495e78bf083abb5807f.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_c722840694ee08ab4f21c5d767a94f12.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_c722840694ee08ab4f21c5d767a94f12.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_1e9813730422c6888be3037085daf4e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e9813730422c6888be3037085daf4e8.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_ff3901db44c404bcfcc8b0922437987d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_ff3901db44c404bcfcc8b0922437987d.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_5bbd1ab40c23a30509b31e18d36a80fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_5bbd1ab40c23a30509b31e18d36a80fa.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_3e2322fdc8188b9de09d5dc18b48256a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_3e2322fdc8188b9de09d5dc18b48256a.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_e217c69e248a7a804ee003a77c8c95a4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_e217c69e248a7a804ee003a77c8c95a4.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_346afd52acf2cb47846aeb2fb9aca8b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_346afd52acf2cb47846aeb2fb9aca8b0.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_55de9abc79742ad62dedd0d6588cca29.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_55de9abc79742ad62dedd0d6588cca29.jpg already downloaded
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F2d%252Ff22d3753bc9fd133f7f2f1bfff921a2d%252Fpa%252FTV84112_1e17939520295a97c23bfe7c51ffd8f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e17939520295a97c23bfe7c51ffd8f4.jpg already downloaded
2026-01-28 17:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20, identifier: TV84112
2026-01-28 17:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 27e1c829-2b38-57ff-949a-fea82149f73b with identifier: ZW53743
2026-01-28 17:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 27e1c829-2b38-57ff-949a-fea82149f73b with identifier: ZW53743
2026-01-28 17:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 27e1c829-2b38-57ff-949a-fea82149f73b with identifier: ZW53743 to the API
2026-01-28 17:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW53743>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:09:43Z',
 'fuel_type': 'electro',
 'id': '27e1c829-2b38-57ff-949a-fea82149f73b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW53743',
 'listing': 'auction',
 'location': 'ES, Manresa',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 39432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 electric drive 100 kW e GT',
 'transmission': 'automatic',
 'trim': 'e GT',
 'year': 2020}
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW53743%27 HTTP/1.1" 200 None
2026-01-28 17:02:37 [auto1.es] INFO: Saving data for ZW53743: {'auction_closing_time': 1769702983.0, 'created_time': 1769421738.867813, 'last_price_update_time': 1769619757.767027}
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZW53743') HTTP/1.1" 204 0
2026-01-28 17:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 with identifier: TV84112
2026-01-28 17:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 with identifier: TV84112
2026-01-28 17:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
2026-01-28 17:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 spider: auto1.es
2026-01-28 17:02:37 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 70d6681f-7c0f-5b8f-88e6-f7b2a694ea20 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:39:14Z',
 'fuel_type': 'diesel',
 'id': '70d6681f-7c0f-5b8f-88e6-f7b2a694ea20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV84112',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 115319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_db51d67cd6745a6490a9cea613ce3cdc.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1ad1b2db8e3bc24cd495f9fe38af2612.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_da75f70d674e824ef077fe51009cb5f5.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_6867373344789495e78bf083abb5807f.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_c722840694ee08ab4f21c5d767a94f12.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e9813730422c6888be3037085daf4e8.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_ff3901db44c404bcfcc8b0922437987d.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_5bbd1ab40c23a30509b31e18d36a80fa.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_3e2322fdc8188b9de09d5dc18b48256a.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_e217c69e248a7a804ee003a77c8c95a4.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_346afd52acf2cb47846aeb2fb9aca8b0.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_55de9abc79742ad62dedd0d6588cca29.jpg',
                'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e17939520295a97c23bfe7c51ffd8f4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405826,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_db51d67cd6745a6490a9cea613ce3cdc.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1ad1b2db8e3bc24cd495f9fe38af2612.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_da75f70d674e824ef077fe51009cb5f5.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_6867373344789495e78bf083abb5807f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_c722840694ee08ab4f21c5d767a94f12.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429598,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e9813730422c6888be3037085daf4e8.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 429598,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_ff3901db44c404bcfcc8b0922437987d.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_5bbd1ab40c23a30509b31e18d36a80fa.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_3e2322fdc8188b9de09d5dc18b48256a.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373722,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_e217c69e248a7a804ee003a77c8c95a4.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_346afd52acf2cb47846aeb2fb9aca8b0.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 308649,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_55de9abc79742ad62dedd0d6588cca29.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70d6681f-7c0f-5b8f-88e6-f7b2a694ea20/70d6681f-7c0f-5b8f-88e6-f7b2a694ea20_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/2d/f22d3753bc9fd133f7f2f1bfff921a2d/pa/TV84112_1e17939520295a97c23bfe7c51ffd8f4.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Furgón',
 'transmission': 'manual',
 'trim': 'Furgón',
 'year': 2021}
2026-01-28 17:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV84112%27 HTTP/1.1" 200 None
2026-01-28 17:02:38 [auto1.es] INFO: Saving data for TV84112: {'created_time': 1769619758.005217, 'last_price_update_time': 1769619758.005228, 'auction_closing_time': 1769704754.0}
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV84112') HTTP/1.1" 204 0
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF97208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY35740> (referer: https://www.auto1.com/v1/car-details-view/NY35740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ48494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ63738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR77788/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f5f10>
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg saved to cache
2026-01-28 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2026-01-28 17:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ffbe907-9d14-5e26-99f6-12edbb319d17 with scrape type 2
2026-01-28 17:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ffbe907-9d14-5e26-99f6-12edbb319d17 with scrape type 2
2026-01-28 17:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ffbe907-9d14-5e26-99f6-12edbb319d17, identifier: NY35740
2026-01-28 17:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2026-01-28 17:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740
2026-01-28 17:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ffbe907-9d14-5e26-99f6-12edbb319d17 with identifier: NY35740 to the API
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY35740>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:41:40Z',
 'fuel_type': 'gas',
 'id': '0ffbe907-9d14-5e26-99f6-12edbb319d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY35740',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 1398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Expression +',
 'transmission': 'manual',
 'trim': 'Stepway Expression +',
 'year': 2025}
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY35740%27 HTTP/1.1" 200 None
2026-01-28 17:02:38 [auto1.es] INFO: Saving data for NY35740: {'auction_closing_time': 1769704900.0, 'created_time': 1767780192.582941, 'last_price_update_time': 1769619758.781552}
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY35740') HTTP/1.1" 204 0
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e1ce710d20b256e3345a1f18253bafab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b372dc757c6eb591d7b52c2735e876c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63375750>
2026-01-28 17:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_e1ce710d20b256e3345a1f18253bafab.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e1ce710d20b256e3345a1f18253bafab.jpg saved to cache
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340e950>
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_b372dc757c6eb591d7b52c2735e876c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b372dc757c6eb591d7b52c2735e876c9.jpg saved to cache
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW77045> (referer: https://www.auto1.com/v1/car-details-view/KW77045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB95025> (referer: https://www.auto1.com/v1/car-details-view/NB95025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10447d60-e120-51f5-b761-fbf9d7a30109 with identifier: KW77045
2026-01-28 17:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10447d60-e120-51f5-b761-fbf9d7a30109 with scrape type 2
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10447d60-e120-51f5-b761-fbf9d7a30109 with scrape type 2
2026-01-28 17:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10447d60-e120-51f5-b761-fbf9d7a30109, identifier: KW77045
2026-01-28 17:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10447d60-e120-51f5-b761-fbf9d7a30109 with identifier: KW77045
2026-01-28 17:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10447d60-e120-51f5-b761-fbf9d7a30109 with identifier: KW77045
2026-01-28 17:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10447d60-e120-51f5-b761-fbf9d7a30109 with identifier: KW77045 to the API
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KW77045>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:38:27Z',
 'fuel_type': 'petrol',
 'id': '10447d60-e120-51f5-b761-fbf9d7a30109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW77045',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 57330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KW77045%27 HTTP/1.1" 200 None
2026-01-28 17:02:39 [auto1.es] INFO: Saving data for KW77045: {'auction_closing_time': 1769704707.0, 'created_time': 1769002828.265838, 'last_price_update_time': 1769619759.926448}
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KW77045') HTTP/1.1" 204 0
2026-01-28 17:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with identifier: NB95025
2026-01-28 17:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with scrape type 2
2026-01-28 17:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with scrape type 2
2026-01-28 17:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5, identifier: NB95025
2026-01-28 17:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with identifier: NB95025
2026-01-28 17:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with identifier: NB95025
2026-01-28 17:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d234f1e9-18fc-535d-8f8f-ee3cb6f39ca5 with identifier: NB95025 to the API
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NB95025>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:46:37Z',
 'fuel_type': 'petrol',
 'id': 'd234f1e9-18fc-535d-8f8f-ee3cb6f39ca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB95025',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 106931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Essential',
 'transmission': 'manual',
 'trim': 'Stepway Essential',
 'year': 2021}
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB95025%27 HTTP/1.1" 200 None
2026-01-28 17:02:40 [auto1.es] INFO: Saving data for NB95025: {'auction_closing_time': 1769705197.0, 'created_time': 1769148035.674535, 'last_price_update_time': 1769619760.349762}
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NB95025') HTTP/1.1" 204 0
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM65680> (referer: https://www.auto1.com/v1/car-details-view/DM65680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82bb3902-c310-5d39-837d-68be9fb2c50b with identifier: DM65680
2026-01-28 17:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82bb3902-c310-5d39-837d-68be9fb2c50b with scrape type 2
2026-01-28 17:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82bb3902-c310-5d39-837d-68be9fb2c50b with scrape type 2
2026-01-28 17:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 82bb3902-c310-5d39-837d-68be9fb2c50b, identifier: DM65680
2026-01-28 17:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 82bb3902-c310-5d39-837d-68be9fb2c50b with identifier: DM65680
2026-01-28 17:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 82bb3902-c310-5d39-837d-68be9fb2c50b with identifier: DM65680
2026-01-28 17:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 82bb3902-c310-5d39-837d-68be9fb2c50b with identifier: DM65680 to the API
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM65680>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:47:33Z',
 'fuel_type': 'petrol',
 'id': '82bb3902-c310-5d39-837d-68be9fb2c50b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM65680',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 101895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM65680%27 HTTP/1.1" 200 None
2026-01-28 17:02:40 [auto1.es] INFO: Saving data for DM65680: {'auction_closing_time': 1769705253.0, 'created_time': 1768823904.24919, 'last_price_update_time': 1769619760.905587}
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM65680') HTTP/1.1" 204 0
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA36026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US72477/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD31300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE14806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6354bdd0>
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg saved to cache
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ35846> (referer: https://www.auto1.com/v1/car-details-view/HZ35846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340aad0>
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252Fdf%252Fe6df1917e486e1266ce3fca353f31e27%252Fpa%252FFG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg saved to cache
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9476257d-8a47-5c67-8d73-0026f951ce8f
2026-01-28 17:02:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9476257d-8a47-5c67-8d73-0026f951ce8f, skipping ID generation
2026-01-28 17:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9476257d-8a47-5c67-8d73-0026f951ce8f with scrape type 1
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9476257d-8a47-5c67-8d73-0026f951ce8f from tracking dictionaries
2026-01-28 17:02:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9476257d-8a47-5c67-8d73-0026f951ce8f sending to next pipeline
2026-01-28 17:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9476257d-8a47-5c67-8d73-0026f951ce8f, identifier: FG84665
2026-01-28 17:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9476257d-8a47-5c67-8d73-0026f951ce8f with identifier: FG84665
2026-01-28 17:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9476257d-8a47-5c67-8d73-0026f951ce8f with identifier: FG84665
2026-01-28 17:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143669 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143669
2026-01-28 17:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 9476257d-8a47-5c67-8d73-0026f951ce8f spider: auto1.es
2026-01-28 17:02:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9476257d-8a47-5c67-8d73-0026f951ce8f due to rule: high_mileage_for_make.json, error: 143669 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143669
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:31:16Z',
 'fuel_type': 'diesel',
 'id': '9476257d-8a47-5c67-8d73-0026f951ce8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG84665',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 143669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_0654deacb1810a8affcc68377a98fc30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_d743bb3b1b837550eb9f61fd669a2f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_aaa534b800c3b15f23b7ecf2d42b39b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_9482d86e0ce5e34aa52568bb9b9bd9c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_caf08a885f8a8f18069b005974014e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b372dc757c6eb591d7b52c2735e876c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e1ce710d20b256e3345a1f18253bafab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_2c75de3ab1eaab9dfb479d2869c4d097.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_90417ea7c11976f13a311e0a075e35b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_6b06aa88f9393cf73677dfc0061afacb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_483666173ea7338db77dda2af02460cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_8e0bf29c0f6a37356f58a4df0f67a67f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_04c5c335ea755f764073e4d045d771b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_e985cf37154f5196ea9225db95197523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_b1e52a9cb0c17d8af91dbffc3db81ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9476257d-8a47-5c67-8d73-0026f951ce8f/9476257d-8a47-5c67-8d73-0026f951ce8f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/df/e6df1917e486e1266ce3fca353f31e27/pa/FG84665_adad69d589a94ce8ee6730814636ccc9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 2018}
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG84665%27 HTTP/1.1" 200 None
2026-01-28 17:02:41 [auto1.es] INFO: Saving data for FG84665: {'created_time': 1769619761.992219, 'last_price_update_time': 1769619761.992229, 'auction_closing_time': 1769704276.0}
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG84665') HTTP/1.1" 204 0
2026-01-28 17:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR72202> (referer: https://www.auto1.com/v1/car-details-view/VR72202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ87320> (referer: https://www.auto1.com/v1/car-details-view/YZ87320/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b with identifier: HZ35846
2026-01-28 17:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbf7bd47-7e51-5f9d-aa63-9fde125bc63b with scrape type 1
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item bbf7bd47-7e51-5f9d-aa63-9fde125bc63b
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_655312c0ac3242b3941055667a8b30f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_655312c0ac3242b3941055667a8b30f0.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_1d5ee844a6171307eb55bebb9b349af2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_1d5ee844a6171307eb55bebb9b349af2.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_d11761de2c205be80d0dd2b7b1958c6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_d11761de2c205be80d0dd2b7b1958c6a.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_cb1d1052ffd7100dbe8c2f099c7f792e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_cb1d1052ffd7100dbe8c2f099c7f792e.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_555a8b50cf22e0ef72ca58db5f47f571.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_555a8b50cf22e0ef72ca58db5f47f571.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_43017e107ada1db7c8a484fdac74b642.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_43017e107ada1db7c8a484fdac74b642.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_c6b6e1b518ae2264140518d66b66339c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_c6b6e1b518ae2264140518d66b66339c.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_957d84618736ff87aa448533ad98f7bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_957d84618736ff87aa448533ad98f7bf.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_6ef73c7f9362e82c909e17dcf87b2151.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6ef73c7f9362e82c909e17dcf87b2151.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_0a523f7aa122bbc3eb74a4abc5c6c620.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_0a523f7aa122bbc3eb74a4abc5c6c620.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_6a25e0eac8ad67a0182a565d8dbcdb27.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6a25e0eac8ad67a0182a565d8dbcdb27.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_89a278005bd7c5b1e3d44e0d29113e22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_89a278005bd7c5b1e3d44e0d29113e22.jpg already downloaded
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F3b%252F313b91ffb63bd3895fee9d3892c80d14%252Fpa%252FHZ35846_3c032ebe756ce6e98cf0c82d000b0c91.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_3c032ebe756ce6e98cf0c82d000b0c91.jpg already downloaded
2026-01-28 17:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b, identifier: HZ35846
2026-01-28 17:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b with identifier: HZ35846
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b with identifier: HZ35846
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b spider: auto1.es
2026-01-28 17:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bbf7bd47-7e51-5f9d-aa63-9fde125bc63b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:55:44Z',
 'fuel_type': 'diesel',
 'id': 'bbf7bd47-7e51-5f9d-aa63-9fde125bc63b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ35846',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 132274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_655312c0ac3242b3941055667a8b30f0.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_1d5ee844a6171307eb55bebb9b349af2.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_d11761de2c205be80d0dd2b7b1958c6a.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_cb1d1052ffd7100dbe8c2f099c7f792e.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_555a8b50cf22e0ef72ca58db5f47f571.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_43017e107ada1db7c8a484fdac74b642.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_c6b6e1b518ae2264140518d66b66339c.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_957d84618736ff87aa448533ad98f7bf.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6ef73c7f9362e82c909e17dcf87b2151.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_0a523f7aa122bbc3eb74a4abc5c6c620.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6a25e0eac8ad67a0182a565d8dbcdb27.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_89a278005bd7c5b1e3d44e0d29113e22.jpg',
                'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_3c032ebe756ce6e98cf0c82d000b0c91.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234336,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_655312c0ac3242b3941055667a8b30f0.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234336,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_1d5ee844a6171307eb55bebb9b349af2.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204894,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_d11761de2c205be80d0dd2b7b1958c6a.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204894,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_cb1d1052ffd7100dbe8c2f099c7f792e.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228534,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_555a8b50cf22e0ef72ca58db5f47f571.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271558,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_43017e107ada1db7c8a484fdac74b642.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271558,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_c6b6e1b518ae2264140518d66b66339c.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 271558,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_957d84618736ff87aa448533ad98f7bf.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 230512,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6ef73c7f9362e82c909e17dcf87b2151.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238645,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_0a523f7aa122bbc3eb74a4abc5c6c620.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 223473,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_6a25e0eac8ad67a0182a565d8dbcdb27.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_89a278005bd7c5b1e3d44e0d29113e22.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbf7bd47-7e51-5f9d-aa63-9fde125bc63b/bbf7bd47-7e51-5f9d-aa63-9fde125bc63b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 238645,
             'Height': 671,
             'OriginUrl': 'https://img-pa.auto1.com/img31/3b/313b91ffb63bd3895fee9d3892c80d14/pa/HZ35846_3c032ebe756ce6e98cf0c82d000b0c91.jpg',
             'Width': 894}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2022}
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ35846%27 HTTP/1.1" 200 None
2026-01-28 17:02:42 [auto1.es] INFO: Saving data for HZ35846: {'created_time': 1769619762.558333, 'last_price_update_time': 1769619762.558345, 'auction_closing_time': 1769705744.0}
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ35846') HTTP/1.1" 204 0
2026-01-28 17:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 with identifier: VR72202
2026-01-28 17:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 with scrape type 2
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 with scrape type 2
2026-01-28 17:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8, identifier: VR72202
2026-01-28 17:02:42 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8a91f6-4a05-5106-accd-604ae671f350 with identifier: YZ87320
2026-01-28 17:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a91f6-4a05-5106-accd-604ae671f350 with scrape type 2
2026-01-28 17:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8a91f6-4a05-5106-accd-604ae671f350 with scrape type 2
2026-01-28 17:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3e8a91f6-4a05-5106-accd-604ae671f350, identifier: YZ87320
2026-01-28 17:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 with identifier: VR72202
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 with identifier: VR72202
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183116
2026-01-28 17:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 spider: auto1.es
2026-01-28 17:02:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8 due to rule: high_mileage_for_country.json, error: 183116 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183116
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:28:08Z',
 'fuel_type': 'petrol',
 'id': 'c5a2031e-b1a6-5268-9e8d-bd0f03c7bbd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR72202',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 183116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR72202%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Saving data for VR72202: {'auction_closing_time': 1769704088.0, 'created_time': 1769519125.584871, 'last_price_update_time': 1769619763.010195}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR72202') HTTP/1.1" 204 0
2026-01-28 17:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3e8a91f6-4a05-5106-accd-604ae671f350 with identifier: YZ87320
2026-01-28 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3e8a91f6-4a05-5106-accd-604ae671f350 with identifier: YZ87320
2026-01-28 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 195852 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195852
2026-01-28 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3e8a91f6-4a05-5106-accd-604ae671f350 spider: auto1.es
2026-01-28 17:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3e8a91f6-4a05-5106-accd-604ae671f350 due to rule: high_mileage_for_country.json, error: 195852 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    195852
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:11:28Z',
 'fuel_type': 'diesel',
 'id': '3e8a91f6-4a05-5106-accd-604ae671f350',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ87320',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 195852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia 1.6 CDTI DPF Excellence',
 'transmission': 'manual',
 'trim': 'Excellence',
 'year': 2017}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YZ87320%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Saving data for YZ87320: {'auction_closing_time': 1769703088.0, 'created_time': 1768842153.358395, 'last_price_update_time': 1769619763.22816}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YZ87320') HTTP/1.1" 204 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: LW77816
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW77816%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for LW77816: 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: KY97566
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for KY97566: 2
2026-01-28 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST27973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF96991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ42135> (referer: https://www.auto1.com/v1/car-details-view/WJ42135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: BM19053
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM19053%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for BM19053: 2
2026-01-28 17:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: BX26344
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX26344%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for BX26344: 2
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: JU32619
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU32619%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for JU32619: 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: ML12744
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML12744%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for ML12744: 2
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: XJ82790
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ82790%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for XJ82790: 1
2026-01-28 17:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3571c67c-bded-5831-ac13-668426a9935e with identifier: WJ42135
2026-01-28 17:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3571c67c-bded-5831-ac13-668426a9935e with scrape type 2
2026-01-28 17:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3571c67c-bded-5831-ac13-668426a9935e with scrape type 2
2026-01-28 17:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3571c67c-bded-5831-ac13-668426a9935e, identifier: WJ42135
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: UL80546
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL80546%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for UL80546: 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: WV68266
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WV68266%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for WV68266: 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: FN22464
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN22464%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for FN22464: 2
2026-01-28 17:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3571c67c-bded-5831-ac13-668426a9935e with identifier: WJ42135
2026-01-28 17:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3571c67c-bded-5831-ac13-668426a9935e with identifier: WJ42135
2026-01-28 17:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3571c67c-bded-5831-ac13-668426a9935e with identifier: WJ42135 to the API
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ42135>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:09:50Z',
 'fuel_type': 'petrol',
 'id': '3571c67c-bded-5831-ac13-668426a9935e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ42135',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 68175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ42135%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Saving data for WJ42135: {'auction_closing_time': 1769702990.0, 'created_time': 1769421831.619563, 'last_price_update_time': 1769619763.933634}
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ42135') HTTP/1.1" 204 0
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: HL96509
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96509%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for HL96509: 2
2026-01-28 17:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH61762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: JU30162
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU30162%27 HTTP/1.1" 200 None
2026-01-28 17:02:43 [auto1.es] INFO: Scrape type for JU30162: 2
2026-01-28 17:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:43 [auto1.es] INFO: Found listing with ID: CA62039
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA62039%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for CA62039: 0
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: HM49033
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM49033%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for HM49033: 2
2026-01-28 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ48494> (referer: https://www.auto1.com/v1/car-details-view/NZ48494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: SU48736
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU48736%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for SU48736: 0
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: DD59936
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DD59936%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for DD59936: 0
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: SK17847
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17847%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for SK17847: 1
2026-01-28 17:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: FR14993
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FR14993%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for FR14993: 0
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: KU19179
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU19179%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for KU19179: 2
2026-01-28 17:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF97208> (referer: https://www.auto1.com/v1/car-details-view/CF97208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: BG76395
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG76395%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for BG76395: 2
2026-01-28 17:02:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7a3ca5-0991-501d-b261-f857a260d23a with identifier: NZ48494
2026-01-28 17:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7a3ca5-0991-501d-b261-f857a260d23a with scrape type 2
2026-01-28 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7a3ca5-0991-501d-b261-f857a260d23a with scrape type 2
2026-01-28 17:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bb7a3ca5-0991-501d-b261-f857a260d23a, identifier: NZ48494
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: SW19124
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW19124%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for SW19124: 2
2026-01-28 17:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bb7a3ca5-0991-501d-b261-f857a260d23a with identifier: NZ48494
2026-01-28 17:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bb7a3ca5-0991-501d-b261-f857a260d23a with identifier: NZ48494
2026-01-28 17:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bb7a3ca5-0991-501d-b261-f857a260d23a with identifier: NZ48494 to the API
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NZ48494>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:52:05Z',
 'fuel_type': 'petrol',
 'id': 'bb7a3ca5-0991-501d-b261-f857a260d23a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ48494',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 22510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDI Mild-Hybrid N Line',
 'transmission': 'automatic',
 'trim': 'N Line',
 'year': 2023}
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NZ48494%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Saving data for NZ48494: {'auction_closing_time': 1769705525.0, 'created_time': 1769518952.379793, 'last_price_update_time': 1769619764.603635}
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NZ48494') HTTP/1.1" 204 0
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: UC51375
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC51375%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for UC51375: 1
2026-01-28 17:02:44 [auto1.es] INFO: Found listing with ID: PB45292
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB45292%27 HTTP/1.1" 200 None
2026-01-28 17:02:44 [auto1.es] INFO: Scrape type for PB45292: 2
2026-01-28 17:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with identifier: CF97208
2026-01-28 17:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with scrape type 2
2026-01-28 17:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with scrape type 2
2026-01-28 17:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f53e1132-2b14-54ec-bd1d-eb61aadaeb20, identifier: CF97208
2026-01-28 17:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with identifier: CF97208
2026-01-28 17:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with identifier: CF97208
2026-01-28 17:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f53e1132-2b14-54ec-bd1d-eb61aadaeb20 with identifier: CF97208 to the API
2026-01-28 17:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CF97208>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:50:36Z',
 'fuel_type': 'hybrid',
 'id': 'f53e1132-2b14-54ec-bd1d-eb61aadaeb20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF97208',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Toyota',
 'model': 'C-HR',
 'odometer': 42223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota C-HR 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF97208%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Saving data for CF97208: {'auction_closing_time': 1769705436.0, 'created_time': 1769518767.481149, 'last_price_update_time': 1769619765.195454}
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CF97208') HTTP/1.1" 204 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: UU73633
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU73633%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for UU73633: 2
2026-01-28 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN00147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR77788> (referer: https://www.auto1.com/v1/car-details-view/GR77788/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: DM42464
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM42464%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for DM42464: 2
2026-01-28 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV43271> (referer: https://www.auto1.com/v1/car-details-view/ZV43271/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN59031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: WH17991
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH17991%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for WH17991: 2
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: YU54882
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU54882%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for YU54882: 2
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: YU83589
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU83589%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for YU83589: 1
2026-01-28 17:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS42714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: VE56795
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE56795%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for VE56795: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: RX12180
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX12180%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for RX12180: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: RP39282
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP39282%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for RP39282: 2
2026-01-28 17:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: TH12996
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH12996%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for TH12996: 2
2026-01-28 17:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 with identifier: GR77788
2026-01-28 17:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 with scrape type 2
2026-01-28 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 with scrape type 2
2026-01-28 17:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536, identifier: GR77788
2026-01-28 17:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with identifier: ZV43271
2026-01-28 17:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with scrape type 2
2026-01-28 17:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with scrape type 2
2026-01-28 17:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b0a88f0-5f3b-5565-8ee6-281e6e84842b, identifier: ZV43271
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: BU91578
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU91578%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for BU91578: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: TD52261
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD52261%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for TD52261: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: GD18695
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD18695%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for GD18695: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: WA49493
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA49493%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for WA49493: 0
2026-01-28 17:02:45 [auto1.es] INFO: Found listing with ID: CE60546
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE60546%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Scrape type for CE60546: 2
2026-01-28 17:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 with identifier: GR77788
2026-01-28 17:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 with identifier: GR77788
2026-01-28 17:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 spider: auto1.es
2026-01-28 17:02:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 09c7404c-f9f8-5d94-b2d3-4ea4a1309536 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:23:42Z',
 'fuel_type': 'diesel',
 'id': '09c7404c-f9f8-5d94-b2d3-4ea4a1309536',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR77788',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 75248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Allure Pack L1',
 'transmission': 'manual',
 'trim': 'Allure Pack L1',
 'year': 2021}
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR77788%27 HTTP/1.1" 200 None
2026-01-28 17:02:45 [auto1.es] INFO: Saving data for GR77788: {'auction_closing_time': 1769703822.0, 'created_time': 1769002741.558382, 'last_price_update_time': 1769619765.915322}
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR77788') HTTP/1.1" 204 0
2026-01-28 17:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with identifier: ZV43271
2026-01-28 17:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with identifier: ZV43271
2026-01-28 17:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7b0a88f0-5f3b-5565-8ee6-281e6e84842b with identifier: ZV43271 to the API
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV43271>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:20:32Z',
 'fuel_type': 'diesel',
 'id': '7b0a88f0-5f3b-5565-8ee6-281e6e84842b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV43271',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Hyundai',
 'model': 'Staria',
 'odometer': 128931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-30',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Hyundai Staria 2.2 CRDi Maxx 2WD',
 'transmission': 'automatic',
 'trim': 'Maxx 2WD',
 'year': 2022}
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV43271%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [auto1.es] INFO: Saving data for ZV43271: {'auction_closing_time': 1769703632.0, 'created_time': 1769421905.003925, 'last_price_update_time': 1769619766.344272}
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV43271') HTTP/1.1" 204 0
2026-01-28 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ63738> (referer: https://www.auto1.com/v1/car-details-view/UJ63738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:46 [auto1.es] INFO: Found listing with ID: NW67921
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW67921%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [auto1.es] INFO: Scrape type for NW67921: 0
2026-01-28 17:02:46 [auto1.es] INFO: Found listing with ID: UF26565
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UF26565%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [auto1.es] INFO: Scrape type for UF26565: 0
2026-01-28 17:02:46 [auto1.es] INFO: Found listing with ID: TW36856
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW36856%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [auto1.es] INFO: Scrape type for TW36856: 2
2026-01-28 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MU67506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE14806> (referer: https://www.auto1.com/v1/car-details-view/XE14806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92debd82-ba1b-531d-9baa-8b01d741ee00 with identifier: UJ63738
2026-01-28 17:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92debd82-ba1b-531d-9baa-8b01d741ee00 with scrape type 2
2026-01-28 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92debd82-ba1b-531d-9baa-8b01d741ee00 with scrape type 2
2026-01-28 17:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92debd82-ba1b-531d-9baa-8b01d741ee00, identifier: UJ63738
2026-01-28 17:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92debd82-ba1b-531d-9baa-8b01d741ee00 with identifier: UJ63738
2026-01-28 17:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92debd82-ba1b-531d-9baa-8b01d741ee00 with identifier: UJ63738
2026-01-28 17:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92debd82-ba1b-531d-9baa-8b01d741ee00 with identifier: UJ63738 to the API
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%2792debd82-ba1b-531d-9baa-8b01d741ee00%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 92debd82-ba1b-531d-9baa-8b01d741ee00: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:02:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UJ63738>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:32:38Z',
 'fuel_type': 'petrol',
 'id': '92debd82-ba1b-531d-9baa-8b01d741ee00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ63738',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 14667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2024}
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UJ63738%27 HTTP/1.1" 200 None
2026-01-28 17:02:46 [auto1.es] INFO: Saving data for UJ63738: {'auction_closing_time': 1769704358.0, 'created_time': 1768824354.447395, 'last_price_update_time': 1769619766.840009}
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UJ63738') HTTP/1.1" 204 0
2026-01-28 17:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4492b948-4ae5-5d34-b5aa-6118ed22b037 with identifier: XE14806
2026-01-28 17:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4492b948-4ae5-5d34-b5aa-6118ed22b037 with scrape type 2
2026-01-28 17:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4492b948-4ae5-5d34-b5aa-6118ed22b037 with scrape type 2
2026-01-28 17:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4492b948-4ae5-5d34-b5aa-6118ed22b037, identifier: XE14806
2026-01-28 17:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4492b948-4ae5-5d34-b5aa-6118ed22b037 with identifier: XE14806
2026-01-28 17:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4492b948-4ae5-5d34-b5aa-6118ed22b037 with identifier: XE14806
2026-01-28 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 35958, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xe14806', 'expiration_date': '2026-01-29t16:11:05z', 'origin_country_code': 'es', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '4492b948-4ae5-5d34-b5aa-6118ed22b037', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 35958}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:11:05z',
     'fuel_type': 'petrol',
     'id': '4492b948-4ae5-5d34-b5aa-6118ed22b037',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xe14806',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 35958,
     'odometer_in_km': 35958,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2020}
2026-01-28 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4492b948-4ae5-5d34-b5aa-6118ed22b037 spider: auto1.es
2026-01-28 17:02:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4492b948-4ae5-5d34-b5aa-6118ed22b037 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech active', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 35958, 'odometer_reading_unit': 'km', 'registration_date': '2020-07-21', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xe14806', 'expiration_date': '2026-01-29t16:11:05z', 'origin_country_code': 'es', 'trim': 'active', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 101, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 105, 'id': '4492b948-4ae5-5d34-b5aa-6118ed22b037', 'current_year_diff': 6, 'age_in_months': 66, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 35958}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 66,
     'auction_title': '',
     'c_o_2_emission_value': 105,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 101,
     'expiration_date': '2026-01-29t16:11:05z',
     'fuel_type': 'petrol',
     'id': '4492b948-4ae5-5d34-b5aa-6118ed22b037',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xe14806',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 35958,
     'odometer_in_km': 35958,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-07-21',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech active',
     'transmission': 'manual',
     'trim': 'active',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:11:05Z',
 'fuel_type': 'petrol',
 'id': '4492b948-4ae5-5d34-b5aa-6118ed22b037',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE14806',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 35958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2020}
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XE14806%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [auto1.es] INFO: Saving data for XE14806: {'auction_closing_time': 1769703065.0, 'created_time': 1768928667.23357, 'last_price_update_time': 1769619767.172012}
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XE14806') HTTP/1.1" 204 0
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US72477> (referer: https://www.auto1.com/v1/car-details-view/US72477/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY97566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3c0ee2-2401-5488-8243-93374688c4c6 with identifier: US72477
2026-01-28 17:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3c0ee2-2401-5488-8243-93374688c4c6 with scrape type 1
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_61cc769f5b09b9bdb4d1869c849348f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_61cc769f5b09b9bdb4d1869c849348f5.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_38583c61007e53c80fd64bf1a1853fda.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_38583c61007e53c80fd64bf1a1853fda.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_b4a834ea6425cf69c817491240a96374.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_b4a834ea6425cf69c817491240a96374.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_50902563915b9159bdf58d219dd598e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_50902563915b9159bdf58d219dd598e0.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_9f6b20e58e29142298b52d4cba160a5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_9f6b20e58e29142298b52d4cba160a5f.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_c79b0a356331914fb64c18fbfc6af9ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c79b0a356331914fb64c18fbfc6af9ef.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_c6c9e189d327fc4c0f1726c7c872a485.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c6c9e189d327fc4c0f1726c7c872a485.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_d2fdec5e6606426185e4350bc9b5b957.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_d2fdec5e6606426185e4350bc9b5b957.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_83b8dc50a65dadd0790633a41e6c394e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_83b8dc50a65dadd0790633a41e6c394e.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_e42f4a01738bc17e1f0ebb460a11750b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_e42f4a01738bc17e1f0ebb460a11750b.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_ef80a6b26b1e779cd794963b29211ba4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ef80a6b26b1e779cd794963b29211ba4.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_77d1e82a5f304ce15f454d4d55e697b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_77d1e82a5f304ce15f454d4d55e697b7.jpg not downloaded yet
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_313e6435c71386e1cb4198a99ae7d6c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_313e6435c71386e1cb4198a99ae7d6c5.jpg not downloaded yet
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA36026> (referer: https://www.auto1.com/v1/car-details-view/SA36026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_48dfdb1b244e19ce034ce5e347cc7411.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_48dfdb1b244e19ce034ce5e347cc7411.jpg not downloaded yet
2026-01-28 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_313e6435c71386e1cb4198a99ae7d6c5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD31300> (referer: https://www.auto1.com/v1/car-details-view/GD31300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6919a068-60e7-5673-841a-e69a388f4381 with identifier: SA36026
2026-01-28 17:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6919a068-60e7-5673-841a-e69a388f4381 with scrape type 2
2026-01-28 17:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6919a068-60e7-5673-841a-e69a388f4381 with scrape type 2
2026-01-28 17:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6919a068-60e7-5673-841a-e69a388f4381, identifier: SA36026
2026-01-28 17:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6919a068-60e7-5673-841a-e69a388f4381 with identifier: SA36026
2026-01-28 17:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6919a068-60e7-5673-841a-e69a388f4381 with identifier: SA36026
2026-01-28 17:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6919a068-60e7-5673-841a-e69a388f4381 with identifier: SA36026 to the API
2026-01-28 17:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SA36026>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:17:18Z',
 'fuel_type': 'diesel',
 'id': '6919a068-60e7-5673-841a-e69a388f4381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA36026',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 82679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi Mild-Hybrid Tech",
 'transmission': 'automatic',
 'trim': 'Tech',
 'year': 2020}
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA36026%27 HTTP/1.1" 200 None
2026-01-28 17:02:48 [auto1.es] INFO: Saving data for SA36026: {'auction_closing_time': 1769703438.0, 'created_time': 1769162663.601862, 'last_price_update_time': 1769619768.18239}
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA36026') HTTP/1.1" 204 0
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_48dfdb1b244e19ce034ce5e347cc7411.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_77d1e82a5f304ce15f454d4d55e697b7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM49033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL96509/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:48 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU73633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:48 [auto1.es] INFO: Found listing with ID: AP34779
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP34779%27 HTTP/1.1" 200 None
2026-01-28 17:02:48 [auto1.es] INFO: Scrape type for AP34779: 2
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282ca10>
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_313e6435c71386e1cb4198a99ae7d6c5.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_313e6435c71386e1cb4198a99ae7d6c5.jpg saved to cache
2026-01-28 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98961c9-4339-5ad7-beee-1c090afae26e with identifier: GD31300
2026-01-28 17:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98961c9-4339-5ad7-beee-1c090afae26e with scrape type 2
2026-01-28 17:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98961c9-4339-5ad7-beee-1c090afae26e with scrape type 2
2026-01-28 17:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e98961c9-4339-5ad7-beee-1c090afae26e, identifier: GD31300
2026-01-28 17:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e98961c9-4339-5ad7-beee-1c090afae26e with identifier: GD31300
2026-01-28 17:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e98961c9-4339-5ad7-beee-1c090afae26e with identifier: GD31300
2026-01-28 17:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e98961c9-4339-5ad7-beee-1c090afae26e with identifier: GD31300 to the API
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GD31300>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.3L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:12:24Z',
 'fuel_type': 'diesel',
 'id': 'e98961c9-4339-5ad7-beee-1c090afae26e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD31300',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Mazda',
 'model': 'CX-60',
 'odometer': 19669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-60 3.3 e-Skyactiv D Homura 2WD',
 'transmission': 'automatic',
 'trim': 'Homura 2WD',
 'year': 2024}
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD31300%27 HTTP/1.1" 200 None
2026-01-28 17:02:48 [auto1.es] INFO: Saving data for GD31300: {'auction_closing_time': 1769703144.0, 'created_time': 1768669284.497999, 'last_price_update_time': 1769619768.916205}
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GD31300') HTTP/1.1" 204 0
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ef80a6b26b1e779cd794963b29211ba4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_e42f4a01738bc17e1f0ebb460a11750b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [auto1.es] INFO: Found listing with ID: FC59242
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC59242%27 HTTP/1.1" 200 None
2026-01-28 17:02:48 [auto1.es] INFO: Scrape type for FC59242: 0
2026-01-28 17:02:48 [auto1.es] INFO: Found listing with ID: BR04177
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR04177%27 HTTP/1.1" 200 None
2026-01-28 17:02:48 [auto1.es] INFO: Scrape type for BR04177: 2
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_83b8dc50a65dadd0790633a41e6c394e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB45292/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_d2fdec5e6606426185e4350bc9b5b957.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c6c9e189d327fc4c0f1726c7c872a485.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:48 [auto1.es] INFO: Found listing with ID: MZ33552
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ33552%27 HTTP/1.1" 200 None
2026-01-28 17:02:49 [auto1.es] INFO: Scrape type for MZ33552: 2
2026-01-28 17:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357ae90>
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_48dfdb1b244e19ce034ce5e347cc7411.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_48dfdb1b244e19ce034ce5e347cc7411.jpg saved to cache
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ccd90>
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_77d1e82a5f304ce15f454d4d55e697b7.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_77d1e82a5f304ce15f454d4d55e697b7.jpg saved to cache
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:49 [auto1.es] INFO: Found listing with ID: LK81480
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK81480%27 HTTP/1.1" 200 None
2026-01-28 17:02:49 [auto1.es] INFO: Scrape type for LK81480: 1
2026-01-28 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UC51375/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c79b0a356331914fb64c18fbfc6af9ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635fb710>
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_ef80a6b26b1e779cd794963b29211ba4.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ef80a6b26b1e779cd794963b29211ba4.jpg saved to cache
2026-01-28 17:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b3350>
2026-01-28 17:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_e42f4a01738bc17e1f0ebb460a11750b.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_e42f4a01738bc17e1f0ebb460a11750b.jpg saved to cache
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b3b10>
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_83b8dc50a65dadd0790633a41e6c394e.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_83b8dc50a65dadd0790633a41e6c394e.jpg saved to cache
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b2690>
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_d2fdec5e6606426185e4350bc9b5b957.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_d2fdec5e6606426185e4350bc9b5b957.jpg saved to cache
2026-01-28 17:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63569b10>
2026-01-28 17:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_c6c9e189d327fc4c0f1726c7c872a485.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c6c9e189d327fc4c0f1726c7c872a485.jpg saved to cache
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:51 [auto1.es] INFO: Found listing with ID: LL73819
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL73819%27 HTTP/1.1" 200 None
2026-01-28 17:02:51 [auto1.es] INFO: Scrape type for LL73819: 1
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_50902563915b9159bdf58d219dd598e0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_9f6b20e58e29142298b52d4cba160a5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU83589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [auto1.es] INFO: Found listing with ID: JR49367
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR49367%27 HTTP/1.1" 200 None
2026-01-28 17:02:51 [auto1.es] INFO: Scrape type for JR49367: 1
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN59031> (referer: https://www.auto1.com/v1/car-details-view/RN59031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW36856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE60546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW19124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH61762> (referer: https://www.auto1.com/v1/car-details-view/SH61762/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a02510>
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_c79b0a356331914fb64c18fbfc6af9ef.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c79b0a356331914fb64c18fbfc6af9ef.jpg saved to cache
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:51 [auto1.es] INFO: Found listing with ID: MU81906
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU81906%27 HTTP/1.1" 200 None
2026-01-28 17:02:51 [auto1.es] INFO: Scrape type for MU81906: 0
2026-01-28 17:02:51 [auto1.es] INFO: Found listing with ID: FK25722
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK25722%27 HTTP/1.1" 200 None
2026-01-28 17:02:51 [auto1.es] INFO: Scrape type for FK25722: 2
2026-01-28 17:02:51 [auto1.es] INFO: Found listing with ID: RY07960
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07960%27 HTTP/1.1" 200 None
2026-01-28 17:02:51 [auto1.es] INFO: Scrape type for RY07960: 2
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a46b90>
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_50902563915b9159bdf58d219dd598e0.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_50902563915b9159bdf58d219dd598e0.jpg saved to cache
2026-01-28 17:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a60a90>
2026-01-28 17:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg saved to cache
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629dc810>
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_9f6b20e58e29142298b52d4cba160a5f.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_9f6b20e58e29142298b52d4cba160a5f.jpg saved to cache
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2026-01-28 17:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3ebfd31-f694-5f53-a31c-b849cd5c631c with scrape type 2
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3ebfd31-f694-5f53-a31c-b849cd5c631c with scrape type 2
2026-01-28 17:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b3ebfd31-f694-5f53-a31c-b849cd5c631c, identifier: RN59031
2026-01-28 17:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f41d6d-7314-5691-8589-36cd182a5138 with identifier: SH61762
2026-01-28 17:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f41d6d-7314-5691-8589-36cd182a5138 with scrape type 2
2026-01-28 17:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35f41d6d-7314-5691-8589-36cd182a5138 with scrape type 2
2026-01-28 17:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35f41d6d-7314-5691-8589-36cd182a5138, identifier: SH61762
2026-01-28 17:02:52 [auto1.es] INFO: Found listing with ID: LX13658
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX13658%27 HTTP/1.1" 200 None
2026-01-28 17:02:52 [auto1.es] INFO: Scrape type for LX13658: 1
2026-01-28 17:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2026-01-28 17:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031
2026-01-28 17:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b3ebfd31-f694-5f53-a31c-b849cd5c631c with identifier: RN59031 to the API
2026-01-28 17:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RN59031>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:16:03Z',
 'fuel_type': 'diesel',
 'id': 'b3ebfd31-f694-5f53-a31c-b849cd5c631c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN59031',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 121590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2019}
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RN59031%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Saving data for RN59031: {'auction_closing_time': 1769703363.0, 'created_time': 1768298899.893453, 'last_price_update_time': 1769619773.457518}
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RN59031') HTTP/1.1" 204 0
2026-01-28 17:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35f41d6d-7314-5691-8589-36cd182a5138 with identifier: SH61762
2026-01-28 17:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35f41d6d-7314-5691-8589-36cd182a5138 with identifier: SH61762
2026-01-28 17:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 35f41d6d-7314-5691-8589-36cd182a5138 with identifier: SH61762 to the API
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SH61762>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:51:45Z',
 'fuel_type': 'petrol',
 'id': '35f41d6d-7314-5691-8589-36cd182a5138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH61762',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 61906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH61762%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Saving data for SH61762: {'auction_closing_time': 1769705505.0, 'created_time': 1766585228.889071, 'last_price_update_time': 1769619773.879775}
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SH61762') HTTP/1.1" 204 0
2026-01-28 17:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_38583c61007e53c80fd64bf1a1853fda.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_b4a834ea6425cf69c817491240a96374.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:02:53 [auto1.es] INFO: Found listing with ID: VP59431
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP59431%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Scrape type for VP59431: 0
2026-01-28 17:02:53 [auto1.es] INFO: Found listing with ID: KG10310
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Scrape type for KG10310: 2
2026-01-28 17:02:53 [auto1.es] INFO: Found listing with ID: EM43105
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM43105%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Scrape type for EM43105: 2
2026-01-28 17:02:53 [auto1.es] INFO: Found listing with ID: SL98070
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL98070%27 HTTP/1.1" 200 None
2026-01-28 17:02:53 [auto1.es] INFO: Scrape type for SL98070: 1
2026-01-28 17:02:53 [auto1.es] INFO: Found listing with ID: UG29289
2026-01-28 17:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG29289%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for UG29289: 0
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: DH78566
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH78566%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for DH78566: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: DE78584
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE78584%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for DE78584: 1
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62811a10>
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_38583c61007e53c80fd64bf1a1853fda.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_38583c61007e53c80fd64bf1a1853fda.jpg saved to cache
2026-01-28 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62870a50>
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_b4a834ea6425cf69c817491240a96374.jpg') HTTP/1.1" 204 0
2026-01-28 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_b4a834ea6425cf69c817491240a96374.jpg saved to cache
2026-01-28 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: NN10692
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN10692%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for NN10692: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: VM73013
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM73013%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for VM73013: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: FN91376
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN91376%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for FN91376: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: AH74484
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH74484%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for AH74484: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: HK93279
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK93279%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for HK93279: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: VE41546
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE41546%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for VE41546: 2
2026-01-28 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: EJ62656
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ62656%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for EJ62656: 2
2026-01-28 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: BM42176
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM42176%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for BM42176: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: PK29781
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK29781%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for PK29781: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: SM62878
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM62878%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for SM62878: 2
2026-01-28 17:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MU67506> (referer: https://www.auto1.com/v1/car-details-view/MU67506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: NE30408
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE30408%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for NE30408: 2
2026-01-28 17:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: ZC86187
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC86187%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for ZC86187: 2
2026-01-28 17:02:54 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: RK77836
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77836%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for RK77836: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: YK49893
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK49893%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for YK49893: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: SW09028
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW09028%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for SW09028: 1
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: CN49784
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN49784%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for CN49784: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: VF01529
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01529%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for VF01529: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: TL86494
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL86494%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for TL86494: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: ZC18028
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC18028%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for ZC18028: 2
2026-01-28 17:02:54 [auto1.es] INFO: Found listing with ID: EP92466
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP92466%27 HTTP/1.1" 200 None
2026-01-28 17:02:54 [auto1.es] INFO: Scrape type for EP92466: 1
2026-01-28 17:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01158fa9-469b-5a5d-9e2a-628f1faff169 with identifier: MU67506
2026-01-28 17:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01158fa9-469b-5a5d-9e2a-628f1faff169 with scrape type 1
2026-01-28 17:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 01158fa9-469b-5a5d-9e2a-628f1faff169
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_8563e0aeaaece6168f82b5933d4cb1b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8563e0aeaaece6168f82b5933d4cb1b8.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_f5ab6335c401baeffe4cc5868826ea2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f5ab6335c401baeffe4cc5868826ea2b.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_f24e85b2532af05674da7d54582aea65.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f24e85b2532af05674da7d54582aea65.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_9bcbd8468ef76e5822ee5451211f6c20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9bcbd8468ef76e5822ee5451211f6c20.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_a64d0a9912acbac5a64ad7191af7dba2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_a64d0a9912acbac5a64ad7191af7dba2.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_b9855f040c281ffdc3fe0561534481df.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b9855f040c281ffdc3fe0561534481df.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_b902af0e3f380a291757fa6299391d6f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b902af0e3f380a291757fa6299391d6f.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_93deb22fe64b8bc838a9ebdd6e3ae23c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_93deb22fe64b8bc838a9ebdd6e3ae23c.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_454a3f64e0fa1c09ca0fbac478ee1898.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_454a3f64e0fa1c09ca0fbac478ee1898.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_9a344162896a1db5a5380e219e86a30c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9a344162896a1db5a5380e219e86a30c.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_2e30a6e48c2bef35ff80d9c7455850ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_2e30a6e48c2bef35ff80d9c7455850ce.jpg already downloaded
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F37%252Fbb37b67295c67033d00ec9693bedb2d4%252Fpa%252FMU67506_8ea697f7bfc99b4bd2b283e0207265c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8ea697f7bfc99b4bd2b283e0207265c0.jpg already downloaded
2026-01-28 17:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01158fa9-469b-5a5d-9e2a-628f1faff169, identifier: MU67506
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: GH37532
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH37532%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for GH37532: 2
2026-01-28 17:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01158fa9-469b-5a5d-9e2a-628f1faff169 with identifier: MU67506
2026-01-28 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01158fa9-469b-5a5d-9e2a-628f1faff169 with identifier: MU67506
2026-01-28 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-28 17:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 01158fa9-469b-5a5d-9e2a-628f1faff169 spider: auto1.es
2026-01-28 17:02:55 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 01158fa9-469b-5a5d-9e2a-628f1faff169 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:20:49Z',
 'fuel_type': 'diesel',
 'id': '01158fa9-469b-5a5d-9e2a-628f1faff169',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU67506',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 141704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8563e0aeaaece6168f82b5933d4cb1b8.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f5ab6335c401baeffe4cc5868826ea2b.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f24e85b2532af05674da7d54582aea65.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9bcbd8468ef76e5822ee5451211f6c20.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_a64d0a9912acbac5a64ad7191af7dba2.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b9855f040c281ffdc3fe0561534481df.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b902af0e3f380a291757fa6299391d6f.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_93deb22fe64b8bc838a9ebdd6e3ae23c.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_454a3f64e0fa1c09ca0fbac478ee1898.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9a344162896a1db5a5380e219e86a30c.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_2e30a6e48c2bef35ff80d9c7455850ce.jpg',
                'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8ea697f7bfc99b4bd2b283e0207265c0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8563e0aeaaece6168f82b5933d4cb1b8.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f5ab6335c401baeffe4cc5868826ea2b.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_f24e85b2532af05674da7d54582aea65.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9bcbd8468ef76e5822ee5451211f6c20.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_a64d0a9912acbac5a64ad7191af7dba2.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b9855f040c281ffdc3fe0561534481df.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_b902af0e3f380a291757fa6299391d6f.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_93deb22fe64b8bc838a9ebdd6e3ae23c.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_454a3f64e0fa1c09ca0fbac478ee1898.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_9a344162896a1db5a5380e219e86a30c.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_2e30a6e48c2bef35ff80d9c7455850ce.jpg',
             'Width': 799},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01158fa9-469b-5a5d-9e2a-628f1faff169/01158fa9-469b-5a5d-9e2a-628f1faff169_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/37/bb37b67295c67033d00ec9693bedb2d4/pa/MU67506_8ea697f7bfc99b4bd2b283e0207265c0.jpg',
             'Width': 799}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 Blue-HDi 335 L2H2 Premium Stop&Start',
 'transmission': 'manual',
 'trim': '335 L2H2 Premium Stop&Start',
 'year': 2022}
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MU67506%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Saving data for MU67506: {'created_time': 1769619775.558055, 'last_price_update_time': 1769619775.558067, 'auction_closing_time': 1769703649.0}
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MU67506') HTTP/1.1" 204 0
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: DE51790
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51790%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for DE51790: 1
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: UN95955
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN95955%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for UN95955: 2
2026-01-28 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR04177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: CC06310
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC06310%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for CC06310: 1
2026-01-28 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB45292> (referer: https://www.auto1.com/v1/car-details-view/PB45292/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS42714> (referer: https://www.auto1.com/v1/car-details-view/DS42714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU73633> (referer: https://www.auto1.com/v1/car-details-view/UU73633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL96509> (referer: https://www.auto1.com/v1/car-details-view/HL96509/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: DS45210
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS45210%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for DS45210: 1
2026-01-28 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: KD77535
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD77535%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for KD77535: 1
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: ZD56270
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD56270%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for ZD56270: 2
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: GE25563
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE25563%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for GE25563: 1
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: DM54288
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM54288%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for DM54288: 2
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: YD18994
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD18994%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for YD18994: 2
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: YC21611
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC21611%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for YC21611: 1
2026-01-28 17:02:55 [auto1.es] INFO: Found listing with ID: BG12504
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG12504%27 HTTP/1.1" 200 None
2026-01-28 17:02:55 [auto1.es] INFO: Scrape type for BG12504: 2
2026-01-28 17:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3c18abf-625f-506d-920b-051b6591adaf with identifier: PB45292
2026-01-28 17:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3c18abf-625f-506d-920b-051b6591adaf with scrape type 2
2026-01-28 17:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3c18abf-625f-506d-920b-051b6591adaf with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e3c18abf-625f-506d-920b-051b6591adaf, identifier: PB45292
2026-01-28 17:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd59477-e802-5045-ace4-c89a5afaa9f8 with identifier: DS42714
2026-01-28 17:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd59477-e802-5045-ace4-c89a5afaa9f8 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd59477-e802-5045-ace4-c89a5afaa9f8 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5cd59477-e802-5045-ace4-c89a5afaa9f8, identifier: DS42714
2026-01-28 17:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b71258b-4538-599b-8f71-5700969b2054 with identifier: UU73633
2026-01-28 17:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b71258b-4538-599b-8f71-5700969b2054 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b71258b-4538-599b-8f71-5700969b2054 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5b71258b-4538-599b-8f71-5700969b2054, identifier: UU73633
2026-01-28 17:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81db5f76-b642-50d3-9a25-b37df78b9c80 with identifier: HL96509
2026-01-28 17:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81db5f76-b642-50d3-9a25-b37df78b9c80 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81db5f76-b642-50d3-9a25-b37df78b9c80 with scrape type 2
2026-01-28 17:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 81db5f76-b642-50d3-9a25-b37df78b9c80, identifier: HL96509
2026-01-28 17:02:56 [auto1.es] INFO: Found listing with ID: BE42716
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE42716%27 HTTP/1.1" 200 None
2026-01-28 17:02:56 [auto1.es] INFO: Scrape type for BE42716: 2
2026-01-28 17:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e3c18abf-625f-506d-920b-051b6591adaf with identifier: PB45292
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e3c18abf-625f-506d-920b-051b6591adaf with identifier: PB45292
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175523 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175523
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e3c18abf-625f-506d-920b-051b6591adaf spider: auto1.es
2026-01-28 17:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e3c18abf-625f-506d-920b-051b6591adaf due to rule: high_mileage_for_country.json, error: 175523 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175523
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:46:24Z',
 'fuel_type': 'diesel',
 'id': 'e3c18abf-625f-506d-920b-051b6591adaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB45292',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 175523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Business Class',
 'transmission': 'automatic',
 'trim': 'Business Class',
 'year': 2018}
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB45292%27 HTTP/1.1" 200 None
2026-01-28 17:02:56 [auto1.es] INFO: Saving data for PB45292: {'auction_closing_time': 1769705184.0, 'created_time': 1769014867.903137, 'last_price_update_time': 1769619776.559954}
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PB45292') HTTP/1.1" 204 0
2026-01-28 17:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5cd59477-e802-5045-ace4-c89a5afaa9f8 with identifier: DS42714
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5cd59477-e802-5045-ace4-c89a5afaa9f8 with identifier: DS42714
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160575 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160575
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5cd59477-e802-5045-ace4-c89a5afaa9f8 spider: auto1.es
2026-01-28 17:02:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5cd59477-e802-5045-ace4-c89a5afaa9f8 due to rule: high_mileage_for_country.json, error: 160575 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160575
{'auction_title': '',
 'c_o_2_emission_value': 96,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:23:23Z',
 'fuel_type': 'gas',
 'id': '5cd59477-e802-5045-ace4-c89a5afaa9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS42714',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 160575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TGI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2020}
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS42714%27 HTTP/1.1" 200 None
2026-01-28 17:02:56 [auto1.es] INFO: Saving data for DS42714: {'auction_closing_time': 1769703803.0, 'created_time': 1768064439.037469, 'last_price_update_time': 1769619776.866174}
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS42714') HTTP/1.1" 204 0
2026-01-28 17:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5b71258b-4538-599b-8f71-5700969b2054 with identifier: UU73633
2026-01-28 17:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5b71258b-4538-599b-8f71-5700969b2054 with identifier: UU73633
2026-01-28 17:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5b71258b-4538-599b-8f71-5700969b2054 with identifier: UU73633 to the API
2026-01-28 17:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UU73633>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:24:07Z',
 'fuel_type': 'diesel',
 'id': '5b71258b-4538-599b-8f71-5700969b2054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU73633',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 57655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU73633%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Saving data for UU73633: {'auction_closing_time': 1769703847.0, 'created_time': 1769519011.926503, 'last_price_update_time': 1769619777.174381}
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UU73633') HTTP/1.1" 204 0
2026-01-28 17:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 81db5f76-b642-50d3-9a25-b37df78b9c80 with identifier: HL96509
2026-01-28 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 81db5f76-b642-50d3-9a25-b37df78b9c80 with identifier: HL96509
2026-01-28 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 166195, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hl96509', 'expiration_date': '2026-01-29t16:45:41z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el prat de llobregat (barcelona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '81db5f76-b642-50d3-9a25-b37df78b9c80', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 166195}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:45:41z',
     'fuel_type': 'petrol',
     'id': '81db5f76-b642-50d3-9a25-b37df78b9c80',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hl96509',
     'listing': 'auction',
     'location': 'es, el prat de llobregat (barcelona)',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 166195,
     'odometer_in_km': 166195,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
2026-01-28 17:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 81db5f76-b642-50d3-9a25-b37df78b9c80 spider: auto1.es
2026-01-28 17:02:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 81db5f76-b642-50d3-9a25-b37df78b9c80 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'automatic', 'odometer': 166195, 'odometer_reading_unit': 'km', 'registration_date': '2018-06-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hl96509', 'expiration_date': '2026-01-29t16:45:41z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el prat de llobregat (barcelona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '81db5f76-b642-50d3-9a25-b37df78b9c80', 'current_year_diff': 8, 'age_in_months': 91, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 166195}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 91,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'blue',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:45:41z',
     'fuel_type': 'petrol',
     'id': '81db5f76-b642-50d3-9a25-b37df78b9c80',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/hl96509',
     'listing': 'auction',
     'location': 'es, el prat de llobregat (barcelona)',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 166195,
     'odometer_in_km': 166195,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-06-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'automatic',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:45:41Z',
 'fuel_type': 'petrol',
 'id': '81db5f76-b642-50d3-9a25-b37df78b9c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL96509',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 166195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL96509%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Saving data for HL96509: {'auction_closing_time': 1769705141.0, 'created_time': 1768474320.721988, 'last_price_update_time': 1769619777.402204}
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL96509') HTTP/1.1" 204 0
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: JX56992
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX56992%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for JX56992: 1
2026-01-28 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK81480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AP34779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: VM98135
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM98135%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for VM98135: 2
2026-01-28 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: KL50046
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL50046%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for KL50046: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: XC93969
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC93969%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for XC93969: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: SW32457
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW32457%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for SW32457: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: MA72623
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA72623%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for MA72623: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: VF97209
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF97209%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for VF97209: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: RP64804
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP64804%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for RP64804: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: YA94679
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA94679%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for YA94679: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: LH94689
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH94689%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for LH94689: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: PA12525
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA12525%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for PA12525: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: UU16488
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU16488%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for UU16488: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: MP76578
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP76578%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for MP76578: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: EG70285
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG70285%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for EG70285: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: FL45309
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL45309%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for FL45309: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: KN45266
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for KN45266: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: MN81981
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for MN81981: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: TL06212
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL06212%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for TL06212: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: SA65804
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA65804%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for SA65804: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: ET29682
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET29682%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for ET29682: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: PT57331
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT57331%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for PT57331: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: PX56700
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX56700%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for PX56700: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: KY66855
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY66855%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for KY66855: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: KX71919
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX71919%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for KX71919: 1
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: CS74140
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS74140%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for CS74140: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: JT04116
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT04116%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for JT04116: 2
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: CS07161
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS07161%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for CS07161: 2
2026-01-28 17:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX13658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: AM88870
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM88870%27 HTTP/1.1" 200 None
2026-01-28 17:02:57 [auto1.es] INFO: Scrape type for AM88870: 2
2026-01-28 17:02:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:57 [auto1.es] INFO: Found listing with ID: TF79942
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF79942%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [auto1.es] INFO: Scrape type for TF79942: 2
2026-01-28 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR49367/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MZ33552/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LL73819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UC51375> (referer: https://www.auto1.com/v1/car-details-view/UC51375/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cde8190-31a8-57fc-ae72-dbffb138afb1 with identifier: UC51375
2026-01-28 17:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cde8190-31a8-57fc-ae72-dbffb138afb1 with scrape type 1
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9cde8190-31a8-57fc-ae72-dbffb138afb1
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_6225b7bb69a429da072ebc6406d6e34f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_6225b7bb69a429da072ebc6406d6e34f.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_30c34f47a11f135d409ec401e29e104f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_30c34f47a11f135d409ec401e29e104f.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_7521da2780450ea59c569985c784f6a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_7521da2780450ea59c569985c784f6a0.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_ce27b111b29450401abdb5d21c492b86.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_ce27b111b29450401abdb5d21c492b86.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_4635e4bb37a3cb6f5daa355831e2f4be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_4635e4bb37a3cb6f5daa355831e2f4be.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_48d25c2130177d9e5428311b563a171e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_48d25c2130177d9e5428311b563a171e.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_8b17bd62397daf9da8900fdc1f38d7b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_8b17bd62397daf9da8900fdc1f38d7b3.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_259bab1d9af8d0a53c1ecff3eef509b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_259bab1d9af8d0a53c1ecff3eef509b3.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_69fe8a40beca60cb684da82a23555a83.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_69fe8a40beca60cb684da82a23555a83.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_94d9a3e65ccf4504225104159e618345.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_94d9a3e65ccf4504225104159e618345.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_5066c14e9370b784a0c61c7f4e8e27c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5066c14e9370b784a0c61c7f4e8e27c1.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_5351a0e690ba846fa8875f9925abf268.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5351a0e690ba846fa8875f9925abf268.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_167a7654659339117bda9c49e2fd70e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_167a7654659339117bda9c49e2fd70e3.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_3ba7cfa8b26fe193702d13a404796307.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_3ba7cfa8b26fe193702d13a404796307.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_016af6ee5f9c5bf684bdadd4853833c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_016af6ee5f9c5bf684bdadd4853833c3.jpg already downloaded
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252F22%252F1e22dd57f66654087fc5d44dbfdf62a2%252Fpa%252FUC51375_f90b746da65c1656c21c1a7268e17716.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_f90b746da65c1656c21c1a7268e17716.jpg already downloaded
2026-01-28 17:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cde8190-31a8-57fc-ae72-dbffb138afb1, identifier: UC51375
2026-01-28 17:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cde8190-31a8-57fc-ae72-dbffb138afb1 with identifier: UC51375
2026-01-28 17:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cde8190-31a8-57fc-ae72-dbffb138afb1 with identifier: UC51375
2026-01-28 17:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cde8190-31a8-57fc-ae72-dbffb138afb1 with identifier: UC51375 to the API
2026-01-28 17:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UC51375>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 272,
 'expiration_date': '2026-01-29T16:10:19Z',
 'fuel_type': 'petrol',
 'id': '9cde8190-31a8-57fc-ae72-dbffb138afb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC51375',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 125604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_6225b7bb69a429da072ebc6406d6e34f.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_30c34f47a11f135d409ec401e29e104f.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_7521da2780450ea59c569985c784f6a0.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_ce27b111b29450401abdb5d21c492b86.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_4635e4bb37a3cb6f5daa355831e2f4be.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_48d25c2130177d9e5428311b563a171e.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_8b17bd62397daf9da8900fdc1f38d7b3.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_259bab1d9af8d0a53c1ecff3eef509b3.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_69fe8a40beca60cb684da82a23555a83.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_94d9a3e65ccf4504225104159e618345.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5066c14e9370b784a0c61c7f4e8e27c1.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5351a0e690ba846fa8875f9925abf268.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_167a7654659339117bda9c49e2fd70e3.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_3ba7cfa8b26fe193702d13a404796307.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_016af6ee5f9c5bf684bdadd4853833c3.jpg',
                'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_f90b746da65c1656c21c1a7268e17716.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_6225b7bb69a429da072ebc6406d6e34f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_30c34f47a11f135d409ec401e29e104f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_7521da2780450ea59c569985c784f6a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_ce27b111b29450401abdb5d21c492b86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_4635e4bb37a3cb6f5daa355831e2f4be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_48d25c2130177d9e5428311b563a171e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_8b17bd62397daf9da8900fdc1f38d7b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_259bab1d9af8d0a53c1ecff3eef509b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_69fe8a40beca60cb684da82a23555a83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_94d9a3e65ccf4504225104159e618345.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5066c14e9370b784a0c61c7f4e8e27c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_5351a0e690ba846fa8875f9925abf268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_167a7654659339117bda9c49e2fd70e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_3ba7cfa8b26fe193702d13a404796307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_016af6ee5f9c5bf684bdadd4853833c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9cde8190-31a8-57fc-ae72-dbffb138afb1/9cde8190-31a8-57fc-ae72-dbffb138afb1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/22/1e22dd57f66654087fc5d44dbfdf62a2/pa/UC51375_f90b746da65c1656c21c1a7268e17716.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP GTi',
 'transmission': 'manual',
 'trim': 'GTi',
 'year': 2017}
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UC51375%27 HTTP/1.1" 200 None
2026-01-28 17:02:59 [auto1.es] INFO: Saving data for UC51375: {'created_time': 1769619779.207115, 'last_price_update_time': 1769619779.207125, 'auction_closing_time': 1769703019.0}
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UC51375') HTTP/1.1" 204 0
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN95955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH37532/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW19124> (referer: https://www.auto1.com/v1/car-details-view/SW19124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM49033> (referer: https://www.auto1.com/v1/car-details-view/HM49033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE41546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE51790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM62878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49a3307-6913-52f1-a48f-b7e3a60bdb12 with identifier: SW19124
2026-01-28 17:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49a3307-6913-52f1-a48f-b7e3a60bdb12 with scrape type 2
2026-01-28 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f49a3307-6913-52f1-a48f-b7e3a60bdb12 with scrape type 2
2026-01-28 17:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f49a3307-6913-52f1-a48f-b7e3a60bdb12, identifier: SW19124
2026-01-28 17:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with identifier: HM49033
2026-01-28 17:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with scrape type 2
2026-01-28 17:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with scrape type 2
2026-01-28 17:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b5a1273b-d06f-5a1e-aa3e-fb3c01f50911, identifier: HM49033
2026-01-28 17:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f49a3307-6913-52f1-a48f-b7e3a60bdb12 with identifier: SW19124
2026-01-28 17:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f49a3307-6913-52f1-a48f-b7e3a60bdb12 with identifier: SW19124
2026-01-28 17:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f49a3307-6913-52f1-a48f-b7e3a60bdb12 with identifier: SW19124 to the API
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW19124>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:59:35Z',
 'fuel_type': 'petrol',
 'id': 'f49a3307-6913-52f1-a48f-b7e3a60bdb12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW19124',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 77841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2017}
2026-01-28 17:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW19124%27 HTTP/1.1" 200 None
2026-01-28 17:03:00 [auto1.es] INFO: Saving data for SW19124: {'auction_closing_time': 1769705975.0, 'created_time': 1767619736.570286, 'last_price_update_time': 1769619780.005437}
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW19124') HTTP/1.1" 204 0
2026-01-28 17:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with identifier: HM49033
2026-01-28 17:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with identifier: HM49033
2026-01-28 17:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b5a1273b-d06f-5a1e-aa3e-fb3c01f50911 with identifier: HM49033 to the API
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM49033>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:25:16Z',
 'fuel_type': 'petrol',
 'id': 'b5a1273b-d06f-5a1e-aa3e-fb3c01f50911',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM49033',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 47887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM49033%27 HTTP/1.1" 200 None
2026-01-28 17:03:00 [auto1.es] INFO: Saving data for HM49033: {'auction_closing_time': 1769703916.0, 'created_time': 1769065281.943971, 'last_price_update_time': 1769619780.355344}
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HM49033') HTTP/1.1" 204 0
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF79942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX56992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP92466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX13658> (referer: https://www.auto1.com/v1/car-details-view/LX13658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS07161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac with identifier: LX13658
2026-01-28 17:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac with scrape type 1
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_127c9fab4eac61899420c511e6886ba4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_753ad8c9179d19910aee0884c96cf3d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_e5b1146065c47931dcb84537c6158794.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_41426ec142f22620fe8a113eee02e913.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg not downloaded yet
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE42716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_2fc2c20c21c639810db26be799d68c0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg not downloaded yet
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_5949504d1295a59b512eede4175b4233.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_e2cdca4ed2d304186b64eaceafa28668.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_583e921a58eb86efb1f31668e40b5091.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg not downloaded yet
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC18028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg not downloaded yet
2026-01-28 17:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_95291d331faaa89718fa6b0a37d30d89.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg not downloaded yet
2026-01-28 17:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_539937f00c66e405d2e42db559da43b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg not downloaded yet
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg not downloaded yet
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a67050>
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_41426ec142f22620fe8a113eee02e913.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg saved to cache
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS74140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63516610>
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_583e921a58eb86efb1f31668e40b5091.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg saved to cache
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62ae5050>
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_95291d331faaa89718fa6b0a37d30d89.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg saved to cache
2026-01-28 17:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT04116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX71919/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MZ33552> (referer: https://www.auto1.com/v1/car-details-view/MZ33552/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e5950>
2026-01-28 17:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg saved to cache
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LL73819> (referer: https://www.auto1.com/v1/car-details-view/LL73819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2026-01-28 17:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d5e1f8-27d1-52c0-a551-81411ae749d0 with scrape type 2
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d5e1f8-27d1-52c0-a551-81411ae749d0 with scrape type 2
2026-01-28 17:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e6d5e1f8-27d1-52c0-a551-81411ae749d0, identifier: MZ33552
2026-01-28 17:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2026-01-28 17:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 with identifier: MZ33552
2026-01-28 17:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 35581, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552', 'expiration_date': '2026-01-29t16:08:43z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el rebolledo (alicante)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 35581}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:08:43z',
     'fuel_type': 'petrol',
     'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552',
     'listing': 'auction',
     'location': 'es, el rebolledo (alicante)',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 35581,
     'odometer_in_km': 35581,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
2026-01-28 17:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e6d5e1f8-27d1-52c0-a551-81411ae749d0 spider: auto1.es
2026-01-28 17:03:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e6d5e1f8-27d1-52c0-a551-81411ae749d0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 308 1.2 puretech gt', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '308', 'transmission': 'automatic', 'odometer': 35581, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-19', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552', 'expiration_date': '2026-01-29t16:08:43z', 'origin_country_code': 'es', 'trim': 'gt', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, el rebolledo (alicante)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 130, 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0', 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 35581}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 30,
     'auction_title': '',
     'c_o_2_emission_value': 130,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:08:43z',
     'fuel_type': 'petrol',
     'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/mz33552',
     'listing': 'auction',
     'location': 'es, el rebolledo (alicante)',
     'make': 'peugeot',
     'make_model': 'peugeot 308',
     'model': '308',
     'odometer': 35581,
     'odometer_in_km': 35581,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-07-19',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 308 1.2 puretech gt',
     'transmission': 'automatic',
     'trim': 'gt',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:08:43Z',
 'fuel_type': 'petrol',
 'id': 'e6d5e1f8-27d1-52c0-a551-81411ae749d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ33552',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 35581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MZ33552%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [auto1.es] INFO: Saving data for MZ33552: {'auction_closing_time': 1769702923.0, 'created_time': 1764761787.424184, 'last_price_update_time': 1769619783.425378}
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MZ33552') HTTP/1.1" 204 0
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR49367> (referer: https://www.auto1.com/v1/car-details-view/JR49367/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY66855/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62988bd0>
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_539937f00c66e405d2e42db559da43b7.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg saved to cache
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7acf82b5-4050-5ee9-bb4b-54fa6353151a with identifier: LL73819
2026-01-28 17:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7acf82b5-4050-5ee9-bb4b-54fa6353151a with scrape type 1
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7acf82b5-4050-5ee9-bb4b-54fa6353151a
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_9a97183bc133063c1091913eed5aa235.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_9a97183bc133063c1091913eed5aa235.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_dd0144bef2b6ec9ae64f8a036882b395.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd0144bef2b6ec9ae64f8a036882b395.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_80d72895b758b600caed50fec09e3c64.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_80d72895b758b600caed50fec09e3c64.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_8965fbdf22a156790ecbab7991cdad21.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8965fbdf22a156790ecbab7991cdad21.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_3c5cbe5dfc6469d687c75819c13e76f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_3c5cbe5dfc6469d687c75819c13e76f7.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_4f64ccf586e601f78112a818821e0645.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_4f64ccf586e601f78112a818821e0645.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_1ccc9a2b9a4834806fc06158ddf46c58.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1ccc9a2b9a4834806fc06158ddf46c58.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_dd4ca202de6cc6ff6b73961b1a3576cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd4ca202de6cc6ff6b73961b1a3576cd.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_bf8d15c92645006f9a16a09f7af403e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_bf8d15c92645006f9a16a09f7af403e2.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_ac72faf3ee6671f97e4f180c74dc0075.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ac72faf3ee6671f97e4f180c74dc0075.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_047304b9ff489b6db03d6d7e422acf2f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_047304b9ff489b6db03d6d7e422acf2f.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_b2da06df61c282db76b8e79dd02cc7f7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_b2da06df61c282db76b8e79dd02cc7f7.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_8e7a23300995b799cb579a1e9ea9c101.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8e7a23300995b799cb579a1e9ea9c101.jpg already downloaded
2026-01-28 17:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_1a68624a26b6bec571133616e81f3cf5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1a68624a26b6bec571133616e81f3cf5.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_ffee5d19b7d3c181028c9e2846c8ece8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ffee5d19b7d3c181028c9e2846c8ece8.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F13%252Ff813c8a8bdf874ec2b9fca97d7f93d73%252Fpa%252FLL73819_734f896bc27ffcf2483f4c5740c302fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_734f896bc27ffcf2483f4c5740c302fb.jpg already downloaded
2026-01-28 17:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7acf82b5-4050-5ee9-bb4b-54fa6353151a, identifier: LL73819
2026-01-28 17:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7acf82b5-4050-5ee9-bb4b-54fa6353151a with identifier: LL73819
2026-01-28 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7acf82b5-4050-5ee9-bb4b-54fa6353151a with identifier: LL73819
2026-01-28 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163395 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163395
2026-01-28 17:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7acf82b5-4050-5ee9-bb4b-54fa6353151a spider: auto1.es
2026-01-28 17:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7acf82b5-4050-5ee9-bb4b-54fa6353151a due to rule: high_mileage_for_country.json, error: 163395 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163395
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:44:29Z',
 'fuel_type': 'diesel',
 'id': '7acf82b5-4050-5ee9-bb4b-54fa6353151a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL73819',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 163395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_9a97183bc133063c1091913eed5aa235.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd0144bef2b6ec9ae64f8a036882b395.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_80d72895b758b600caed50fec09e3c64.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8965fbdf22a156790ecbab7991cdad21.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_3c5cbe5dfc6469d687c75819c13e76f7.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_4f64ccf586e601f78112a818821e0645.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1ccc9a2b9a4834806fc06158ddf46c58.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd4ca202de6cc6ff6b73961b1a3576cd.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_bf8d15c92645006f9a16a09f7af403e2.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ac72faf3ee6671f97e4f180c74dc0075.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_047304b9ff489b6db03d6d7e422acf2f.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_b2da06df61c282db76b8e79dd02cc7f7.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8e7a23300995b799cb579a1e9ea9c101.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1a68624a26b6bec571133616e81f3cf5.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ffee5d19b7d3c181028c9e2846c8ece8.jpg',
                'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_734f896bc27ffcf2483f4c5740c302fb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_9a97183bc133063c1091913eed5aa235.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2057572,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd0144bef2b6ec9ae64f8a036882b395.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_80d72895b758b600caed50fec09e3c64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8965fbdf22a156790ecbab7991cdad21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_3c5cbe5dfc6469d687c75819c13e76f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_4f64ccf586e601f78112a818821e0645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1ccc9a2b9a4834806fc06158ddf46c58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_dd4ca202de6cc6ff6b73961b1a3576cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_bf8d15c92645006f9a16a09f7af403e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ac72faf3ee6671f97e4f180c74dc0075.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_047304b9ff489b6db03d6d7e422acf2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_b2da06df61c282db76b8e79dd02cc7f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_8e7a23300995b799cb579a1e9ea9c101.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_1a68624a26b6bec571133616e81f3cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_ffee5d19b7d3c181028c9e2846c8ece8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7acf82b5-4050-5ee9-bb4b-54fa6353151a/7acf82b5-4050-5ee9-bb4b-54fa6353151a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/13/f813c8a8bdf874ec2b9fca97d7f93d73/pa/LL73819_734f896bc27ffcf2483f4c5740c302fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LL73819%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [auto1.es] INFO: Saving data for LL73819: {'created_time': 1769619784.379111, 'last_price_update_time': 1769619784.379122, 'auction_closing_time': 1769705069.0}
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LL73819') HTTP/1.1" 204 0
2026-01-28 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM62878> (referer: https://www.auto1.com/v1/car-details-view/SM62878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX56700/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AM88870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62915e90>
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg saved to cache
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa344dba-41dd-5f29-a7d3-fff468de2739 with identifier: JR49367
2026-01-28 17:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa344dba-41dd-5f29-a7d3-fff468de2739 with scrape type 1
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item fa344dba-41dd-5f29-a7d3-fff468de2739
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_75d2b3acaa89202b205f69b37fb4daca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_75d2b3acaa89202b205f69b37fb4daca.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_96090e6c62ebf6aefaf1a1126d3af7ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_96090e6c62ebf6aefaf1a1126d3af7ed.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_226796ddd7bd84f2beed437150dc9e79.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_226796ddd7bd84f2beed437150dc9e79.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_9d58da3f6f57bd6e8be69f05fbef0381.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_9d58da3f6f57bd6e8be69f05fbef0381.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_641c90ec45a0204da946260953c0ae09.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_641c90ec45a0204da946260953c0ae09.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_b9c0a908bcf87f71af62d75e498638ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_b9c0a908bcf87f71af62d75e498638ab.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_ac24256f2ae663c0d87a585c6a68c13c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ac24256f2ae663c0d87a585c6a68c13c.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_f6a33fea3c3e63a01487fa2b47c950d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f6a33fea3c3e63a01487fa2b47c950d9.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_64cb82536c85540ea334ee0ebdfe6269.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_64cb82536c85540ea334ee0ebdfe6269.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_51a9a74b6f49ba1966799ab6171f22d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_51a9a74b6f49ba1966799ab6171f22d2.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_2820598bcee27c769c16663cbcfc04f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_2820598bcee27c769c16663cbcfc04f5.jpg already downloaded
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_ca0b2733b876628eb02aa605af8a0113.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ca0b2733b876628eb02aa605af8a0113.jpg already downloaded
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_a965c3decd3b15a5a2c75102e3e056ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_a965c3decd3b15a5a2c75102e3e056ff.jpg already downloaded
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_ce2c03e9278055c22ee92064d1221029.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ce2c03e9278055c22ee92064d1221029.jpg already downloaded
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252F67%252Fb5676a1194697bec60bcfe27077f8e89%252Fpa%252FJR49367_f835528f6fc9225efb08e80fc4f79773.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f835528f6fc9225efb08e80fc4f79773.jpg already downloaded
2026-01-28 17:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa344dba-41dd-5f29-a7d3-fff468de2739, identifier: JR49367
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63486b90>
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_e2cdca4ed2d304186b64eaceafa28668.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg saved to cache
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290d810>
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg saved to cache
2026-01-28 17:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa344dba-41dd-5f29-a7d3-fff468de2739 with identifier: JR49367
2026-01-28 17:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa344dba-41dd-5f29-a7d3-fff468de2739 with identifier: JR49367
2026-01-28 17:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa344dba-41dd-5f29-a7d3-fff468de2739 with identifier: JR49367 to the API
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR49367>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-01-29T16:39:12Z',
 'fuel_type': 'diesel',
 'id': 'fa344dba-41dd-5f29-a7d3-fff468de2739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR49367',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 47010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_75d2b3acaa89202b205f69b37fb4daca.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_96090e6c62ebf6aefaf1a1126d3af7ed.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_226796ddd7bd84f2beed437150dc9e79.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_9d58da3f6f57bd6e8be69f05fbef0381.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_641c90ec45a0204da946260953c0ae09.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_b9c0a908bcf87f71af62d75e498638ab.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ac24256f2ae663c0d87a585c6a68c13c.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f6a33fea3c3e63a01487fa2b47c950d9.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_64cb82536c85540ea334ee0ebdfe6269.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_51a9a74b6f49ba1966799ab6171f22d2.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_2820598bcee27c769c16663cbcfc04f5.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ca0b2733b876628eb02aa605af8a0113.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_a965c3decd3b15a5a2c75102e3e056ff.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ce2c03e9278055c22ee92064d1221029.jpg',
                'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f835528f6fc9225efb08e80fc4f79773.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_75d2b3acaa89202b205f69b37fb4daca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_96090e6c62ebf6aefaf1a1126d3af7ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_226796ddd7bd84f2beed437150dc9e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_9d58da3f6f57bd6e8be69f05fbef0381.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_641c90ec45a0204da946260953c0ae09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_b9c0a908bcf87f71af62d75e498638ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ac24256f2ae663c0d87a585c6a68c13c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f6a33fea3c3e63a01487fa2b47c950d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_64cb82536c85540ea334ee0ebdfe6269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_51a9a74b6f49ba1966799ab6171f22d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_2820598bcee27c769c16663cbcfc04f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ca0b2733b876628eb02aa605af8a0113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_a965c3decd3b15a5a2c75102e3e056ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_ce2c03e9278055c22ee92064d1221029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa344dba-41dd-5f29-a7d3-fff468de2739/fa344dba-41dd-5f29-a7d3-fff468de2739_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/67/b5676a1194697bec60bcfe27077f8e89/pa/JR49367_f835528f6fc9225efb08e80fc4f79773.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 M40d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JR49367%27 HTTP/1.1" 200 None
2026-01-28 17:03:06 [auto1.es] INFO: Saving data for JR49367: {'created_time': 1769619786.061298, 'last_price_update_time': 1769619786.061309, 'auction_closing_time': 1769704752.0}
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JR49367') HTTP/1.1" 204 0
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:06 [scrapy.extensions.logstats] INFO: Crawled 444 pages (at 165 pages/min), scraped 127 items (at 49 items/min)
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP92466> (referer: https://www.auto1.com/v1/car-details-view/EP92466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF79942> (referer: https://www.auto1.com/v1/car-details-view/TF79942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE51790> (referer: https://www.auto1.com/v1/car-details-view/DE51790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f912e30f-25f8-5855-bd4e-1adbe99a622a with identifier: SM62878
2026-01-28 17:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f912e30f-25f8-5855-bd4e-1adbe99a622a with scrape type 2
2026-01-28 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f912e30f-25f8-5855-bd4e-1adbe99a622a with scrape type 2
2026-01-28 17:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f912e30f-25f8-5855-bd4e-1adbe99a622a, identifier: SM62878
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634862d0>
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_5949504d1295a59b512eede4175b4233.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg saved to cache
2026-01-28 17:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f912e30f-25f8-5855-bd4e-1adbe99a622a with identifier: SM62878
2026-01-28 17:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f912e30f-25f8-5855-bd4e-1adbe99a622a with identifier: SM62878
2026-01-28 17:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f912e30f-25f8-5855-bd4e-1adbe99a622a with identifier: SM62878 to the API
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM62878>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:55:46Z',
 'fuel_type': 'diesel',
 'id': 'f912e30f-25f8-5855-bd4e-1adbe99a622a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM62878',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 83376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM62878%27 HTTP/1.1" 200 None
2026-01-28 17:03:06 [auto1.es] INFO: Saving data for SM62878: {'auction_closing_time': 1769705746.0, 'created_time': 1767365075.231012, 'last_price_update_time': 1769619786.82841}
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM62878') HTTP/1.1" 204 0
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6364a750>
2026-01-28 17:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_2fc2c20c21c639810db26be799d68c0b.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg saved to cache
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 with identifier: EP92466
2026-01-28 17:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 with scrape type 1
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item aa130f89-e2d0-551c-8c7c-ffdc2bb111f4
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_b374fbc9062ba0778beecf35c205ced8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_b374fbc9062ba0778beecf35c205ced8.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_a214b84a148fd131463d7a754c0e81d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a214b84a148fd131463d7a754c0e81d4.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_cb42cb4285fdc519323ffd102147aaa2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_cb42cb4285fdc519323ffd102147aaa2.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_5fde1f18c014eaed930af73088694c7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_5fde1f18c014eaed930af73088694c7c.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_baf5b6d5f81d24819987a59e28c7a0dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_baf5b6d5f81d24819987a59e28c7a0dc.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_bdaf6de1410016eefc5030f46b5df10e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_bdaf6de1410016eefc5030f46b5df10e.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_ddaafb40b0e1a45d5464f67ea85a9484.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ddaafb40b0e1a45d5464f67ea85a9484.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_1a3152af37bb45c80194fc3630e9528b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_1a3152af37bb45c80194fc3630e9528b.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_6310bb858874a173d499be26d8cc3ac5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_6310bb858874a173d499be26d8cc3ac5.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_c8076389f56d0eafcb6c50dfc49202ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c8076389f56d0eafcb6c50dfc49202ea.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_16896416e1910b8fca341a079ec533c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_16896416e1910b8fca341a079ec533c3.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_c35a6b44366a0e28855c2e0196d235f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c35a6b44366a0e28855c2e0196d235f8.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_78915cb2d1f16cad580f4c1624754177.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_78915cb2d1f16cad580f4c1624754177.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_a14dfa22e432fc32027071dd70cdbd7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a14dfa22e432fc32027071dd70cdbd7d.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_06c8f2d4dbbfec59131e8f315f434a8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_06c8f2d4dbbfec59131e8f315f434a8e.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252F71%252F7d71b5a1153a8b9c7d48f59409c58d46%252Fpa%252FEP92466_ce2f6c116b34c5d74e0637f1d0ad023c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ce2f6c116b34c5d74e0637f1d0ad023c.jpg already downloaded
2026-01-28 17:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4, identifier: EP92466
2026-01-28 17:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 423613ed-3f89-5c3a-b0ed-f686282ade2a with identifier: TF79942
2026-01-28 17:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 423613ed-3f89-5c3a-b0ed-f686282ade2a with scrape type 2
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 423613ed-3f89-5c3a-b0ed-f686282ade2a with scrape type 2
2026-01-28 17:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 423613ed-3f89-5c3a-b0ed-f686282ade2a, identifier: TF79942
2026-01-28 17:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f978282b-a5bf-526d-9f75-c8324a087249 with identifier: DE51790
2026-01-28 17:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f978282b-a5bf-526d-9f75-c8324a087249 with scrape type 1
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f978282b-a5bf-526d-9f75-c8324a087249
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_6c4a43ac7cd6ce1cda19a678894e5fc8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6c4a43ac7cd6ce1cda19a678894e5fc8.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_e0a18067f38bcc2a777c841bfe95ee89.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_e0a18067f38bcc2a777c841bfe95ee89.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_0e3bc86f9718636f54e35da289d34b9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_0e3bc86f9718636f54e35da289d34b9e.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_245f1bf758e43e684f0f45c219abbf0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_245f1bf758e43e684f0f45c219abbf0a.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_3e238f586f902ef47c01e690e6b2abb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_3e238f586f902ef47c01e690e6b2abb0.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_f19ff4fa52d313fcf0879c925fe57978.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_f19ff4fa52d313fcf0879c925fe57978.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_6e4d39e383b45a9affcf93ea0e7a8efb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6e4d39e383b45a9affcf93ea0e7a8efb.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_6f6dec5be179611080054ee6635573dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6f6dec5be179611080054ee6635573dc.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_b478cd88567164538a593786438acb63.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b478cd88567164538a593786438acb63.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_4ab927093aaaa9f78009838630bf92b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_4ab927093aaaa9f78009838630bf92b0.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_d85b653e817506f472398c2bcb3a435f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_d85b653e817506f472398c2bcb3a435f.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_03635c459d641291950f02ddef9a38a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_03635c459d641291950f02ddef9a38a9.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_b406364a138cd75ced96da56335e8857.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b406364a138cd75ced96da56335e8857.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_c7b9e75ea79feb9b5237cb82d9ed967c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_c7b9e75ea79feb9b5237cb82d9ed967c.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_7ca829286ba9ab72ca65aa525026a717.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_7ca829286ba9ab72ca65aa525026a717.jpg already downloaded
2026-01-28 17:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252Fd2%252F73d2802b1a28f41edc552bcdb91dd311%252Fpa%252FDE51790_339fc7f8ea33b6b1eb8532911013917d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_339fc7f8ea33b6b1eb8532911013917d.jpg already downloaded
2026-01-28 17:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f978282b-a5bf-526d-9f75-c8324a087249, identifier: DE51790
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634939d0>
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_e5b1146065c47931dcb84537c6158794.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg saved to cache
2026-01-28 17:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 with identifier: EP92466
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 with identifier: EP92466
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178109 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178109
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 spider: auto1.es
2026-01-28 17:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: aa130f89-e2d0-551c-8c7c-ffdc2bb111f4 due to rule: high_mileage_for_country.json, error: 178109 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178109
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:30:57Z',
 'fuel_type': 'diesel',
 'id': 'aa130f89-e2d0-551c-8c7c-ffdc2bb111f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP92466',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 178109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_b374fbc9062ba0778beecf35c205ced8.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a214b84a148fd131463d7a754c0e81d4.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_cb42cb4285fdc519323ffd102147aaa2.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_5fde1f18c014eaed930af73088694c7c.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_baf5b6d5f81d24819987a59e28c7a0dc.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_bdaf6de1410016eefc5030f46b5df10e.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ddaafb40b0e1a45d5464f67ea85a9484.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_1a3152af37bb45c80194fc3630e9528b.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_6310bb858874a173d499be26d8cc3ac5.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c8076389f56d0eafcb6c50dfc49202ea.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_16896416e1910b8fca341a079ec533c3.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c35a6b44366a0e28855c2e0196d235f8.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_78915cb2d1f16cad580f4c1624754177.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a14dfa22e432fc32027071dd70cdbd7d.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_06c8f2d4dbbfec59131e8f315f434a8e.jpg',
                'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ce2f6c116b34c5d74e0637f1d0ad023c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_b374fbc9062ba0778beecf35c205ced8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a214b84a148fd131463d7a754c0e81d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_cb42cb4285fdc519323ffd102147aaa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_5fde1f18c014eaed930af73088694c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_baf5b6d5f81d24819987a59e28c7a0dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_bdaf6de1410016eefc5030f46b5df10e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ddaafb40b0e1a45d5464f67ea85a9484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_1a3152af37bb45c80194fc3630e9528b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_6310bb858874a173d499be26d8cc3ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c8076389f56d0eafcb6c50dfc49202ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_16896416e1910b8fca341a079ec533c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_c35a6b44366a0e28855c2e0196d235f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_78915cb2d1f16cad580f4c1624754177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_a14dfa22e432fc32027071dd70cdbd7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_06c8f2d4dbbfec59131e8f315f434a8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa130f89-e2d0-551c-8c7c-ffdc2bb111f4/aa130f89-e2d0-551c-8c7c-ffdc2bb111f4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/71/7d71b5a1153a8b9c7d48f59409c58d46/pa/EP92466_ce2f6c116b34c5d74e0637f1d0ad023c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EP92466%27 HTTP/1.1" 200 None
2026-01-28 17:03:08 [auto1.es] INFO: Saving data for EP92466: {'created_time': 1769619788.635311, 'last_price_update_time': 1769619788.635322, 'auction_closing_time': 1769704257.0}
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EP92466') HTTP/1.1" 204 0
2026-01-28 17:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 423613ed-3f89-5c3a-b0ed-f686282ade2a with identifier: TF79942
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 423613ed-3f89-5c3a-b0ed-f686282ade2a with identifier: TF79942
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 423613ed-3f89-5c3a-b0ed-f686282ade2a spider: auto1.es
2026-01-28 17:03:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 423613ed-3f89-5c3a-b0ed-f686282ade2a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:24:45Z',
 'fuel_type': 'diesel',
 'id': '423613ed-3f89-5c3a-b0ed-f686282ade2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF79942',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 195020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TF79942%27 HTTP/1.1" 200 None
2026-01-28 17:03:08 [auto1.es] INFO: Saving data for TF79942: {'auction_closing_time': 1769703885.0, 'created_time': 1769061738.351158, 'last_price_update_time': 1769619788.858623}
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TF79942') HTTP/1.1" 204 0
2026-01-28 17:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f978282b-a5bf-526d-9f75-c8324a087249 with identifier: DE51790
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f978282b-a5bf-526d-9f75-c8324a087249 with identifier: DE51790
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166408 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166408
2026-01-28 17:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f978282b-a5bf-526d-9f75-c8324a087249 spider: auto1.es
2026-01-28 17:03:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f978282b-a5bf-526d-9f75-c8324a087249 due to rule: high_mileage_for_country.json, error: 166408 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166408
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 195,
 'expiration_date': '2026-01-29T16:18:36Z',
 'fuel_type': 'petrol',
 'id': 'f978282b-a5bf-526d-9f75-c8324a087249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE51790',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 166408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6c4a43ac7cd6ce1cda19a678894e5fc8.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_e0a18067f38bcc2a777c841bfe95ee89.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_0e3bc86f9718636f54e35da289d34b9e.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_245f1bf758e43e684f0f45c219abbf0a.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_3e238f586f902ef47c01e690e6b2abb0.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_f19ff4fa52d313fcf0879c925fe57978.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6e4d39e383b45a9affcf93ea0e7a8efb.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6f6dec5be179611080054ee6635573dc.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b478cd88567164538a593786438acb63.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_4ab927093aaaa9f78009838630bf92b0.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_d85b653e817506f472398c2bcb3a435f.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_03635c459d641291950f02ddef9a38a9.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b406364a138cd75ced96da56335e8857.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_c7b9e75ea79feb9b5237cb82d9ed967c.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_7ca829286ba9ab72ca65aa525026a717.jpg',
                'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_339fc7f8ea33b6b1eb8532911013917d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6c4a43ac7cd6ce1cda19a678894e5fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_e0a18067f38bcc2a777c841bfe95ee89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_0e3bc86f9718636f54e35da289d34b9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_245f1bf758e43e684f0f45c219abbf0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_3e238f586f902ef47c01e690e6b2abb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_f19ff4fa52d313fcf0879c925fe57978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6e4d39e383b45a9affcf93ea0e7a8efb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_6f6dec5be179611080054ee6635573dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b478cd88567164538a593786438acb63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_4ab927093aaaa9f78009838630bf92b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_d85b653e817506f472398c2bcb3a435f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_03635c459d641291950f02ddef9a38a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_b406364a138cd75ced96da56335e8857.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_c7b9e75ea79feb9b5237cb82d9ed967c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_7ca829286ba9ab72ca65aa525026a717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f978282b-a5bf-526d-9f75-c8324a087249/f978282b-a5bf-526d-9f75-c8324a087249_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/d2/73d2802b1a28f41edc552bcdb91dd311/pa/DE51790_339fc7f8ea33b6b1eb8532911013917d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Zenith AWD',
 'transmission': 'automatic',
 'trim': 'Zenith AWD',
 'year': 2018}
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51790%27 HTTP/1.1" 200 None
2026-01-28 17:03:09 [auto1.es] INFO: Saving data for DE51790: {'created_time': 1769619789.129865, 'last_price_update_time': 1769619789.129877, 'auction_closing_time': 1769703516.0}
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE51790') HTTP/1.1" 204 0
2026-01-28 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC18028> (referer: https://www.auto1.com/v1/car-details-view/ZC18028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX56992> (referer: https://www.auto1.com/v1/car-details-view/JX56992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX71919> (referer: https://www.auto1.com/v1/car-details-view/KX71919/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE42716> (referer: https://www.auto1.com/v1/car-details-view/BE42716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS74140> (referer: https://www.auto1.com/v1/car-details-view/CS74140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ef210>
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_127c9fab4eac61899420c511e6886ba4.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg saved to cache
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a0cd0>
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg07%252Fdb%252F07db42635e2b38d3dc07530cb1e04788%252Fpa%252FLX13658_753ad8c9179d19910aee0884c96cf3d9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg saved to cache
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac
2026-01-28 17:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac, skipping ID generation
2026-01-28 17:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac with scrape type 1
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac from tracking dictionaries
2026-01-28 17:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38bdf180-9c02-5ca7-81aa-23c7a781a0ac sending to next pipeline
2026-01-28 17:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac, identifier: LX13658
2026-01-28 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac with identifier: LX13658
2026-01-28 17:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac with identifier: LX13658
2026-01-28 17:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 64400, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx13658', 'expiration_date': '2026-01-29t16:01:05z', 'origin_country_code': 'es', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': '38bdf180-9c02-5ca7-81aa-23c7a781a0ac', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 146137}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 133358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 163803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 163803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 107079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 114915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 172811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63993}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 64400}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:01:05z',
     'fuel_type': 'petrol',
     'id': '38bdf180-9c02-5ca7-81aa-23c7a781a0ac',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx13658',
     'listing': 'auction',
     'location': 'es',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 64400,
     'odometer_in_km': 64400,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76719,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76719,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 146137,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 133358,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64181,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 163803,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 163803,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 107079,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62139,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 114915,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 172811,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47312,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63993,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2023}
2026-01-28 17:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac spider: auto1.es
2026-01-28 17:03:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38bdf180-9c02-5ca7-81aa-23c7a781a0ac due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 aircross 1.2 puretech c-series', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3 aircross', 'transmission': 'manual', 'odometer': 64400, 'odometer_reading_unit': 'km', 'registration_date': '2023-10-29', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx13658', 'expiration_date': '2026-01-29t16:01:05z', 'origin_country_code': 'es', 'trim': 'c-series', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'c_o_2_emission_value': None, 'id': '38bdf180-9c02-5ca7-81aa-23c7a781a0ac', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76719}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 146137}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 133358}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64181}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 163803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 163803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 107079}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 114915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 172811}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47312}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63993}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'citroen c3 aircross', 'sanitized_make': 'citroen', 'odometer_in_km': 64400}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 26,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:01:05z',
     'fuel_type': 'petrol',
     'id': '38bdf180-9c02-5ca7-81aa-23c7a781a0ac',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lx13658',
     'listing': 'auction',
     'location': 'es',
     'make': 'citroen',
     'make_model': 'citroen c3 aircross',
     'model': 'c3 aircross',
     'odometer': 64400,
     'odometer_in_km': 64400,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76719,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76719,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 146137,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 133358,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64181,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 163803,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 163803,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 107079,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62139,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 114915,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 172811,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47312,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63993,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-10-29',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 aircross 1.2 puretech c-series',
     'transmission': 'manual',
     'trim': 'c-series',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:01:05Z',
 'fuel_type': 'petrol',
 'id': '38bdf180-9c02-5ca7-81aa-23c7a781a0ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX13658',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 64400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_127c9fab4eac61899420c511e6886ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_753ad8c9179d19910aee0884c96cf3d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 146137,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e5b1146065c47931dcb84537c6158794.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133358,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_41426ec142f22620fe8a113eee02e913.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_2fc2c20c21c639810db26be799d68c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163803,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_5949504d1295a59b512eede4175b4233.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 163803,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_e2cdca4ed2d304186b64eaceafa28668.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_b53900cb8cbc97525e6a59ddc7d31c69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_583e921a58eb86efb1f31668e40b5091.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114915,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_871c2c663b98f9fcf0c5f1bbddb91736.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172811,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_95291d331faaa89718fa6b0a37d30d89.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_539937f00c66e405d2e42db559da43b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38bdf180-9c02-5ca7-81aa-23c7a781a0ac/38bdf180-9c02-5ca7-81aa-23c7a781a0ac_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img07/db/07db42635e2b38d3dc07530cb1e04788/pa/LX13658_1f71ebd9bfb6b3fcfec226b1d20ba249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2023}
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX13658%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [auto1.es] INFO: Saving data for LX13658: {'created_time': 1769619790.09062, 'last_price_update_time': 1769619790.090632, 'auction_closing_time': 1769702465.0}
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX13658') HTTP/1.1" 204 0
2026-01-28 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY66855> (referer: https://www.auto1.com/v1/car-details-view/KY66855/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT04116> (referer: https://www.auto1.com/v1/car-details-view/JT04116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7ac251-1e99-5571-8ee1-471d433e3ef9 with identifier: ZC18028
2026-01-28 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7ac251-1e99-5571-8ee1-471d433e3ef9 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a7ac251-1e99-5571-8ee1-471d433e3ef9 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a7ac251-1e99-5571-8ee1-471d433e3ef9, identifier: ZC18028
2026-01-28 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04cd57b4-af26-583e-aff8-4e84aca20f3b with identifier: JX56992
2026-01-28 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04cd57b4-af26-583e-aff8-4e84aca20f3b with scrape type 1
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 04cd57b4-af26-583e-aff8-4e84aca20f3b
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_ba9819ffa142712a93a8f513794bf71f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_ba9819ffa142712a93a8f513794bf71f.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_55272eb98bb725fba96da87c52f3c821.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_55272eb98bb725fba96da87c52f3c821.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_771227a11915e1a84835dd3c10143530.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_771227a11915e1a84835dd3c10143530.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_22d7e4e44786dbaa53b91cd2c8a90a5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_22d7e4e44786dbaa53b91cd2c8a90a5f.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_cc4136481864a314799a6e59c0713a6f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_cc4136481864a314799a6e59c0713a6f.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_eddedf248e0e896500c8475687fbd60c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_eddedf248e0e896500c8475687fbd60c.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_c3dc6e3c5ed8b030be87a631e025aaa5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c3dc6e3c5ed8b030be87a631e025aaa5.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_003c5a77c64e8ff1545fe2aad23bb912.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_003c5a77c64e8ff1545fe2aad23bb912.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_c8a68b814438f2e18eedce794e1508e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c8a68b814438f2e18eedce794e1508e7.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_2f3ca7119d99635995ace7fcc635f4dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_2f3ca7119d99635995ace7fcc635f4dd.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_b17f9e545987fb3cf3e1f6333ae9f68a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_b17f9e545987fb3cf3e1f6333ae9f68a.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_6d60873d9a86f541847947ae178d898c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_6d60873d9a86f541847947ae178d898c.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_daaa83d97dbb6817cf52b52481ad02ba.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_daaa83d97dbb6817cf52b52481ad02ba.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_75b79d38c57601c3368d9a8c061362a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_75b79d38c57601c3368d9a8c061362a6.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_e4780a7f6635783ebff0be3e0046fa38.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_e4780a7f6635783ebff0be3e0046fa38.jpg already downloaded
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F9c%252F789cfa728175d4cd46ca31562525005b%252Fpa%252FJX56992_aa5ddcf08513234bb72d67d94dd063d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_aa5ddcf08513234bb72d67d94dd063d0.jpg already downloaded
2026-01-28 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04cd57b4-af26-583e-aff8-4e84aca20f3b, identifier: JX56992
2026-01-28 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with identifier: KX71919
2026-01-28 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with scrape type 1
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg not downloaded yet
2026-01-28 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f11ceb6c-26f8-5f06-8110-1c69bd2e4792 with identifier: BE42716
2026-01-28 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f11ceb6c-26f8-5f06-8110-1c69bd2e4792 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f11ceb6c-26f8-5f06-8110-1c69bd2e4792 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f11ceb6c-26f8-5f06-8110-1c69bd2e4792, identifier: BE42716
2026-01-28 17:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7653b47b-766f-5ffe-926c-acab464e1e86 with identifier: CS74140
2026-01-28 17:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7653b47b-766f-5ffe-926c-acab464e1e86 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7653b47b-766f-5ffe-926c-acab464e1e86 with scrape type 2
2026-01-28 17:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7653b47b-766f-5ffe-926c-acab464e1e86, identifier: CS74140
2026-01-28 17:03:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a7ac251-1e99-5571-8ee1-471d433e3ef9 with identifier: ZC18028
2026-01-28 17:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a7ac251-1e99-5571-8ee1-471d433e3ef9 with identifier: ZC18028
2026-01-28 17:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 181425 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181425
2026-01-28 17:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3a7ac251-1e99-5571-8ee1-471d433e3ef9 spider: auto1.es
2026-01-28 17:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3a7ac251-1e99-5571-8ee1-471d433e3ef9 due to rule: high_mileage_for_country.json, error: 181425 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    181425
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:47:40Z',
 'fuel_type': 'diesel',
 'id': '3a7ac251-1e99-5571-8ee1-471d433e3ef9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC18028',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 181425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC18028%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [auto1.es] INFO: Saving data for ZC18028: {'auction_closing_time': 1769705260.0, 'created_time': 1768298875.269281, 'last_price_update_time': 1769619791.110327}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC18028') HTTP/1.1" 204 0
2026-01-28 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04cd57b4-af26-583e-aff8-4e84aca20f3b with identifier: JX56992
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04cd57b4-af26-583e-aff8-4e84aca20f3b with identifier: JX56992
2026-01-28 17:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 04cd57b4-af26-583e-aff8-4e84aca20f3b with identifier: JX56992 to the API
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JX56992>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:13:10Z',
 'fuel_type': 'diesel',
 'id': '04cd57b4-af26-583e-aff8-4e84aca20f3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX56992',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 84899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_ba9819ffa142712a93a8f513794bf71f.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_55272eb98bb725fba96da87c52f3c821.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_771227a11915e1a84835dd3c10143530.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_22d7e4e44786dbaa53b91cd2c8a90a5f.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_cc4136481864a314799a6e59c0713a6f.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_eddedf248e0e896500c8475687fbd60c.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c3dc6e3c5ed8b030be87a631e025aaa5.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_003c5a77c64e8ff1545fe2aad23bb912.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c8a68b814438f2e18eedce794e1508e7.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_2f3ca7119d99635995ace7fcc635f4dd.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_b17f9e545987fb3cf3e1f6333ae9f68a.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_6d60873d9a86f541847947ae178d898c.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_daaa83d97dbb6817cf52b52481ad02ba.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_75b79d38c57601c3368d9a8c061362a6.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_e4780a7f6635783ebff0be3e0046fa38.jpg',
                'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_aa5ddcf08513234bb72d67d94dd063d0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_ba9819ffa142712a93a8f513794bf71f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_55272eb98bb725fba96da87c52f3c821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_771227a11915e1a84835dd3c10143530.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_22d7e4e44786dbaa53b91cd2c8a90a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_cc4136481864a314799a6e59c0713a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_eddedf248e0e896500c8475687fbd60c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c3dc6e3c5ed8b030be87a631e025aaa5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_003c5a77c64e8ff1545fe2aad23bb912.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_c8a68b814438f2e18eedce794e1508e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_2f3ca7119d99635995ace7fcc635f4dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_b17f9e545987fb3cf3e1f6333ae9f68a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_6d60873d9a86f541847947ae178d898c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_daaa83d97dbb6817cf52b52481ad02ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_75b79d38c57601c3368d9a8c061362a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_e4780a7f6635783ebff0be3e0046fa38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04cd57b4-af26-583e-aff8-4e84aca20f3b/04cd57b4-af26-583e-aff8-4e84aca20f3b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/9c/789cfa728175d4cd46ca31562525005b/pa/JX56992_aa5ddcf08513234bb72d67d94dd063d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style Go',
 'transmission': 'manual',
 'trim': 'Style Go',
 'year': 2020}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX56992%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [auto1.es] INFO: Saving data for JX56992: {'created_time': 1769619791.454636, 'last_price_update_time': 1769619791.454647, 'auction_closing_time': 1769703190.0}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JX56992') HTTP/1.1" 204 0
2026-01-28 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f11ceb6c-26f8-5f06-8110-1c69bd2e4792 with identifier: BE42716
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f11ceb6c-26f8-5f06-8110-1c69bd2e4792 with identifier: BE42716
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 quartz 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 140539, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/be42716', 'expiration_date': '2026-01-29t16:27:09z', 'origin_country_code': 'es', 'trim': 'quartz 4x2', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, granyanella', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6a', 'c_o_2_emission_value': 159, 'id': 'f11ceb6c-26f8-5f06-8110-1c69bd2e4792', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 140539}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 159,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6a',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:27:09z',
     'fuel_type': 'petrol',
     'id': 'f11ceb6c-26f8-5f06-8110-1c69bd2e4792',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/be42716',
     'listing': 'auction',
     'location': 'es, granyanella',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 140539,
     'odometer_in_km': 140539,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-01-06',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 quartz 4x2',
     'transmission': 'manual',
     'trim': 'quartz 4x2',
     'year': 2019}
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: f11ceb6c-26f8-5f06-8110-1c69bd2e4792 spider: auto1.es
2026-01-28 17:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f11ceb6c-26f8-5f06-8110-1c69bd2e4792 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 quartz 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 140539, 'odometer_reading_unit': 'km', 'registration_date': '2019-01-06', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/be42716', 'expiration_date': '2026-01-29t16:27:09z', 'origin_country_code': 'es', 'trim': 'quartz 4x2', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, granyanella', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6a', 'c_o_2_emission_value': 159, 'id': 'f11ceb6c-26f8-5f06-8110-1c69bd2e4792', 'current_year_diff': 7, 'age_in_months': 84, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 140539}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 84,
     'auction_title': '',
     'c_o_2_emission_value': 159,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6a',
     'engine': '1.6l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:27:09z',
     'fuel_type': 'petrol',
     'id': 'f11ceb6c-26f8-5f06-8110-1c69bd2e4792',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/be42716',
     'listing': 'auction',
     'location': 'es, granyanella',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 140539,
     'odometer_in_km': 140539,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-01-06',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 quartz 4x2',
     'transmission': 'manual',
     'trim': 'quartz 4x2',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.6L',
 'engine_horse_power': 128,
 'expiration_date': '2026-01-29T16:27:09Z',
 'fuel_type': 'petrol',
 'id': 'f11ceb6c-26f8-5f06-8110-1c69bd2e4792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE42716',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 140539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.6 Quartz 4x2',
 'transmission': 'manual',
 'trim': 'Quartz 4x2',
 'year': 2019}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE42716%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [auto1.es] INFO: Saving data for BE42716: {'auction_closing_time': 1769704029.0, 'created_time': 1769447145.436714, 'last_price_update_time': 1769619791.671833}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE42716') HTTP/1.1" 204 0
2026-01-28 17:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7653b47b-766f-5ffe-926c-acab464e1e86 with identifier: CS74140
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7653b47b-766f-5ffe-926c-acab464e1e86 with identifier: CS74140
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7653b47b-766f-5ffe-926c-acab464e1e86 spider: auto1.es
2026-01-28 17:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7653b47b-766f-5ffe-926c-acab464e1e86 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:12:17Z',
 'fuel_type': 'diesel',
 'id': '7653b47b-766f-5ffe-926c-acab464e1e86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS74140',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 171491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS74140%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [auto1.es] INFO: Saving data for CS74140: {'auction_closing_time': 1769703137.0, 'created_time': 1769061748.758716, 'last_price_update_time': 1769619791.890669}
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS74140') HTTP/1.1" 204 0
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_4625306da8d600ba5d578f93c16ddff3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_4625306da8d600ba5d578f93c16ddff3.jpg not downloaded yet
2026-01-28 17:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS07161> (referer: https://www.auto1.com/v1/car-details-view/CS07161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_384c1148826fc7c5e9581d663372e2e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_384c1148826fc7c5e9581d663372e2e6.jpg not downloaded yet
2026-01-28 17:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22f284b8-b5c9-5b20-a0a5-7b21c14543df with identifier: KY66855
2026-01-28 17:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22f284b8-b5c9-5b20-a0a5-7b21c14543df with scrape type 2
2026-01-28 17:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22f284b8-b5c9-5b20-a0a5-7b21c14543df with scrape type 2
2026-01-28 17:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22f284b8-b5c9-5b20-a0a5-7b21c14543df, identifier: KY66855
2026-01-28 17:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with identifier: JT04116
2026-01-28 17:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with scrape type 2
2026-01-28 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with scrape type 2
2026-01-28 17:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d, identifier: JT04116
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg not downloaded yet
2026-01-28 17:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22f284b8-b5c9-5b20-a0a5-7b21c14543df with identifier: KY66855
2026-01-28 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22f284b8-b5c9-5b20-a0a5-7b21c14543df with identifier: KY66855
2026-01-28 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 22f284b8-b5c9-5b20-a0a5-7b21c14543df spider: auto1.es
2026-01-28 17:03:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 22f284b8-b5c9-5b20-a0a5-7b21c14543df due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:07:19Z',
 'fuel_type': 'diesel',
 'id': '22f284b8-b5c9-5b20-a0a5-7b21c14543df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY66855',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 171939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY66855%27 HTTP/1.1" 200 None
2026-01-28 17:03:12 [auto1.es] INFO: Saving data for KY66855: {'auction_closing_time': 1769702839.0, 'created_time': 1769148216.887728, 'last_price_update_time': 1769619792.40211}
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KY66855') HTTP/1.1" 204 0
2026-01-28 17:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with identifier: JT04116
2026-01-28 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with identifier: JT04116
2026-01-28 17:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1d88d3a7-0e77-5f70-867a-b7231dfe7a4d with identifier: JT04116 to the API
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JT04116>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:28:04Z',
 'fuel_type': 'hybrid',
 'id': '1d88d3a7-0e77-5f70-867a-b7231dfe7a4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT04116',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 48788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2022}
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JT04116%27 HTTP/1.1" 200 None
2026-01-28 17:03:12 [auto1.es] INFO: Saving data for JT04116: {'auction_closing_time': 1769704084.0, 'created_time': 1767780238.914471, 'last_price_update_time': 1769619792.777559}
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JT04116') HTTP/1.1" 204 0
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg not downloaded yet
2026-01-28 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ET29682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT57331/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH37532> (referer: https://www.auto1.com/v1/car-details-view/GH37532/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 with identifier: CS07161
2026-01-28 17:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 with scrape type 2
2026-01-28 17:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 with scrape type 2
2026-01-28 17:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8, identifier: CS07161
2026-01-28 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 with identifier: CS07161
2026-01-28 17:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 with identifier: CS07161
2026-01-28 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 spider: auto1.es
2026-01-28 17:03:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d37a24fa-bc29-5fee-a8b7-2a1649c36aa8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:22:12Z',
 'fuel_type': 'diesel',
 'id': 'd37a24fa-bc29-5fee-a8b7-2a1649c36aa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS07161',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 184858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CS07161%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [auto1.es] INFO: Saving data for CS07161: {'auction_closing_time': 1769703732.0, 'created_time': 1769061747.975208, 'last_price_update_time': 1769619793.120015}
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CS07161') HTTP/1.1" 204 0
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_85d422c13f79265ab4b3eac2694f7110.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_85d422c13f79265ab4b3eac2694f7110.jpg not downloaded yet
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN95955> (referer: https://www.auto1.com/v1/car-details-view/UN95955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE41546> (referer: https://www.auto1.com/v1/car-details-view/VE41546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_7d9998e878753436554450e4beb87336.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_7d9998e878753436554450e4beb87336.jpg not downloaded yet
2026-01-28 17:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2026-01-28 17:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b726524-3d95-5444-baf6-4b2789afa45e with scrape type 2
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b726524-3d95-5444-baf6-4b2789afa45e with scrape type 2
2026-01-28 17:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b726524-3d95-5444-baf6-4b2789afa45e, identifier: GH37532
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_4625306da8d600ba5d578f93c16ddff3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_538aba52b51cf8059f14d7874fe024d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_538aba52b51cf8059f14d7874fe024d9.jpg not downloaded yet
2026-01-28 17:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2026-01-28 17:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532
2026-01-28 17:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b726524-3d95-5444-baf6-4b2789afa45e with identifier: GH37532 to the API
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH37532>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:11:21Z',
 'fuel_type': 'diesel',
 'id': '1b726524-3d95-5444-baf6-4b2789afa45e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH37532',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 75112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 1.5 Blue-HDi C-Series',
 'transmission': 'manual',
 'trim': 'C-Series',
 'year': 2021}
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH37532%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [auto1.es] INFO: Saving data for GH37532: {'auction_closing_time': 1769703081.0, 'created_time': 1767780191.399798, 'last_price_update_time': 1769619793.661899}
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH37532') HTTP/1.1" 204 0
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_cd3fba25102383b7e5c2169f482c044c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_cd3fba25102383b7e5c2169f482c044c.jpg not downloaded yet
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_384c1148826fc7c5e9581d663372e2e6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA65804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AM88870> (referer: https://www.auto1.com/v1/car-details-view/AM88870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef46606-e51c-5020-8aa2-c56120b6672a with identifier: UN95955
2026-01-28 17:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef46606-e51c-5020-8aa2-c56120b6672a with scrape type 2
2026-01-28 17:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef46606-e51c-5020-8aa2-c56120b6672a with scrape type 2
2026-01-28 17:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ef46606-e51c-5020-8aa2-c56120b6672a, identifier: UN95955
2026-01-28 17:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634da4d0>
2026-01-28 17:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg saved to cache
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with identifier: VE41546
2026-01-28 17:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with scrape type 2
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with scrape type 2
2026-01-28 17:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5, identifier: VE41546
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291a3d0>
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_4625306da8d600ba5d578f93c16ddff3.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_4625306da8d600ba5d578f93c16ddff3.jpg saved to cache
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_96ec119ae01cb744df89a39fceacb371.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_96ec119ae01cb744df89a39fceacb371.jpg not downloaded yet
2026-01-28 17:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ef46606-e51c-5020-8aa2-c56120b6672a with identifier: UN95955
2026-01-28 17:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ef46606-e51c-5020-8aa2-c56120b6672a with identifier: UN95955
2026-01-28 17:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3ef46606-e51c-5020-8aa2-c56120b6672a spider: auto1.es
2026-01-28 17:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3ef46606-e51c-5020-8aa2-c56120b6672a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:23:04Z',
 'fuel_type': 'petrol',
 'id': '3ef46606-e51c-5020-8aa2-c56120b6672a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN95955',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 112278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 e-THP 20 Aniversario Edition',
 'transmission': 'manual',
 'trim': '20 Aniversario Edition',
 'year': 2018}
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN95955%27 HTTP/1.1" 200 None
2026-01-28 17:03:14 [auto1.es] INFO: Saving data for UN95955: {'auction_closing_time': 1769703784.0, 'created_time': 1768825655.411202, 'last_price_update_time': 1769619794.788145}
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN95955') HTTP/1.1" 204 0
2026-01-28 17:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with identifier: VE41546
2026-01-28 17:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with identifier: VE41546
2026-01-28 17:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5 with identifier: VE41546 to the API
2026-01-28 17:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE41546>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:39:49Z',
 'fuel_type': 'diesel',
 'id': '91c9f5b7-e565-5ae8-9f9d-fed2f797cbf5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE41546',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'BMW',
 'model': '2er',
 'odometer': 116091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VE41546%27 HTTP/1.1" 200 None
2026-01-28 17:03:15 [auto1.es] INFO: Saving data for VE41546: {'auction_closing_time': 1769704789.0, 'created_time': 1766062934.175108, 'last_price_update_time': 1769619795.194994}
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VE41546') HTTP/1.1" 204 0
2026-01-28 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_7d9998e878753436554450e4beb87336.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_86988f234086ad158b356eb4dc6b4b7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_86988f234086ad158b356eb4dc6b4b7d.jpg not downloaded yet
2026-01-28 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN45266/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX56700> (referer: https://www.auto1.com/v1/car-details-view/PX56700/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL06212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN81981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b2710>
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_384c1148826fc7c5e9581d663372e2e6.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_384c1148826fc7c5e9581d663372e2e6.jpg saved to cache
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633aec50>
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg saved to cache
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b0d2dbf-cedd-5347-9831-762ec0d98261 with identifier: AM88870
2026-01-28 17:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b0d2dbf-cedd-5347-9831-762ec0d98261 with scrape type 2
2026-01-28 17:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b0d2dbf-cedd-5347-9831-762ec0d98261 with scrape type 2
2026-01-28 17:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8b0d2dbf-cedd-5347-9831-762ec0d98261, identifier: AM88870
2026-01-28 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8b0d2dbf-cedd-5347-9831-762ec0d98261 with identifier: AM88870
2026-01-28 17:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8b0d2dbf-cedd-5347-9831-762ec0d98261 with identifier: AM88870
2026-01-28 17:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8b0d2dbf-cedd-5347-9831-762ec0d98261 spider: auto1.es
2026-01-28 17:03:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8b0d2dbf-cedd-5347-9831-762ec0d98261 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:59:15Z',
 'fuel_type': 'diesel',
 'id': '8b0d2dbf-cedd-5347-9831-762ec0d98261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM88870',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 174303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AM88870%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [auto1.es] INFO: Saving data for AM88870: {'auction_closing_time': 1769705955.0, 'created_time': 1769061745.388757, 'last_price_update_time': 1769619796.153785}
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AM88870') HTTP/1.1" 204 0
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628a01d0>
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg saved to cache
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_85d422c13f79265ab4b3eac2694f7110.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg not downloaded yet
2026-01-28 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_538aba52b51cf8059f14d7874fe024d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EG70285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b694a4110>
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_7d9998e878753436554450e4beb87336.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_7d9998e878753436554450e4beb87336.jpg saved to cache
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10790a0b-2c78-5532-8f7c-9fd03041a43f with identifier: PX56700
2026-01-28 17:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10790a0b-2c78-5532-8f7c-9fd03041a43f with scrape type 1
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 10790a0b-2c78-5532-8f7c-9fd03041a43f
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_aa32f0d49014ecb51f183a8020d113df.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aa32f0d49014ecb51f183a8020d113df.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_643b828965bbedd4873716412673c4aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_643b828965bbedd4873716412673c4aa.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_aec3687e0bc74eca7ed56dd0f7162e2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aec3687e0bc74eca7ed56dd0f7162e2e.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_1eff22e9ee08bdc45ddd69cde16c26ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1eff22e9ee08bdc45ddd69cde16c26ae.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_f298d1cdbb6f5ac76faaa26fe4cbd7dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_f298d1cdbb6f5ac76faaa26fe4cbd7dd.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_a4675af2d9ab7f69fc5c52601b8669f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_a4675af2d9ab7f69fc5c52601b8669f5.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_1ebf75757f0c0515fd598ab583a0452f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1ebf75757f0c0515fd598ab583a0452f.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_73d6103488195e8031a0eb3e7c529d90.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_73d6103488195e8031a0eb3e7c529d90.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_53185c2f5f0cb13cc4e8c192071ce4e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_53185c2f5f0cb13cc4e8c192071ce4e1.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_21541c27517fc03330bd7a6bc35143f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_21541c27517fc03330bd7a6bc35143f2.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_6dab52baa38a3adfef49a86510c2a4e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_6dab52baa38a3adfef49a86510c2a4e5.jpg already downloaded
2026-01-28 17:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_3fff2f9707586fbd3825329bea9b542a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3fff2f9707586fbd3825329bea9b542a.jpg already downloaded
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_8ef7e6b250dc2a16eea2f9a0e3b6ca68.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_8ef7e6b250dc2a16eea2f9a0e3b6ca68.jpg already downloaded
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_3480f8a794c84378a4df0b4b1b501d2c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3480f8a794c84378a4df0b4b1b501d2c.jpg already downloaded
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_bb9bf155eb86a7bc5fa258e650d67da4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_bb9bf155eb86a7bc5fa258e650d67da4.jpg already downloaded
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252Ffb%252Fc9fbb95aa92fd65eaa9b84d2562e370c%252Fpa%252FPX56700_b91ab043d24feff1dad039f8f434c7d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_b91ab043d24feff1dad039f8f434c7d1.jpg already downloaded
2026-01-28 17:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 10790a0b-2c78-5532-8f7c-9fd03041a43f, identifier: PX56700
2026-01-28 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_cd3fba25102383b7e5c2169f482c044c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_ec6bc065c85218100875f85b207b6652.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_ec6bc065c85218100875f85b207b6652.jpg not downloaded yet
2026-01-28 17:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 10790a0b-2c78-5532-8f7c-9fd03041a43f with identifier: PX56700
2026-01-28 17:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 10790a0b-2c78-5532-8f7c-9fd03041a43f with identifier: PX56700
2026-01-28 17:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 10790a0b-2c78-5532-8f7c-9fd03041a43f with identifier: PX56700 to the API
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX56700>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:13:40Z',
 'fuel_type': 'diesel',
 'id': '10790a0b-2c78-5532-8f7c-9fd03041a43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX56700',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'BMW',
 'model': '2er',
 'odometer': 30016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aa32f0d49014ecb51f183a8020d113df.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_643b828965bbedd4873716412673c4aa.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aec3687e0bc74eca7ed56dd0f7162e2e.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1eff22e9ee08bdc45ddd69cde16c26ae.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_f298d1cdbb6f5ac76faaa26fe4cbd7dd.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_a4675af2d9ab7f69fc5c52601b8669f5.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1ebf75757f0c0515fd598ab583a0452f.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_73d6103488195e8031a0eb3e7c529d90.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_53185c2f5f0cb13cc4e8c192071ce4e1.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_21541c27517fc03330bd7a6bc35143f2.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_6dab52baa38a3adfef49a86510c2a4e5.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3fff2f9707586fbd3825329bea9b542a.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_8ef7e6b250dc2a16eea2f9a0e3b6ca68.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3480f8a794c84378a4df0b4b1b501d2c.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_bb9bf155eb86a7bc5fa258e650d67da4.jpg',
                'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_b91ab043d24feff1dad039f8f434c7d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aa32f0d49014ecb51f183a8020d113df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_643b828965bbedd4873716412673c4aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_aec3687e0bc74eca7ed56dd0f7162e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1eff22e9ee08bdc45ddd69cde16c26ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_f298d1cdbb6f5ac76faaa26fe4cbd7dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_a4675af2d9ab7f69fc5c52601b8669f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_1ebf75757f0c0515fd598ab583a0452f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_73d6103488195e8031a0eb3e7c529d90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_53185c2f5f0cb13cc4e8c192071ce4e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_21541c27517fc03330bd7a6bc35143f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_6dab52baa38a3adfef49a86510c2a4e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3fff2f9707586fbd3825329bea9b542a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_8ef7e6b250dc2a16eea2f9a0e3b6ca68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_3480f8a794c84378a4df0b4b1b501d2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_bb9bf155eb86a7bc5fa258e650d67da4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10790a0b-2c78-5532-8f7c-9fd03041a43f/10790a0b-2c78-5532-8f7c-9fd03041a43f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/fb/c9fbb95aa92fd65eaa9b84d2562e370c/pa/PX56700_b91ab043d24feff1dad039f8f434c7d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX56700%27 HTTP/1.1" 200 None
2026-01-28 17:03:17 [auto1.es] INFO: Saving data for PX56700: {'created_time': 1769619797.515761, 'last_price_update_time': 1769619797.515772, 'auction_closing_time': 1769703220.0}
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX56700') HTTP/1.1" 204 0
2026-01-28 17:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_96ec119ae01cb744df89a39fceacb371.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344f810>
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_85d422c13f79265ab4b3eac2694f7110.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_85d422c13f79265ab4b3eac2694f7110.jpg saved to cache
2026-01-28 17:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634eb510>
2026-01-28 17:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_538aba52b51cf8059f14d7874fe024d9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_538aba52b51cf8059f14d7874fe024d9.jpg saved to cache
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365d210>
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_cd3fba25102383b7e5c2169f482c044c.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_cd3fba25102383b7e5c2169f482c044c.jpg saved to cache
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_86988f234086ad158b356eb4dc6b4b7d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL45309/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UU16488/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP76578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62acc310>
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_96ec119ae01cb744df89a39fceacb371.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_96ec119ae01cb744df89a39fceacb371.jpg saved to cache
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_ec6bc065c85218100875f85b207b6652.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH94689/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63699dd0>
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg saved to cache
2026-01-28 17:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c0f50>
2026-01-28 17:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_86988f234086ad158b356eb4dc6b4b7d.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_86988f234086ad158b356eb4dc6b4b7d.jpg saved to cache
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ET29682> (referer: https://www.auto1.com/v1/car-details-view/ET29682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA12525/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT57331> (referer: https://www.auto1.com/v1/car-details-view/PT57331/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA94679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288de10>
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge6%252F79%252Fe679e53c836a59ec76d42df83bbfd199%252Fpa%252FKX71919_ec6bc065c85218100875f85b207b6652.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_ec6bc065c85218100875f85b207b6652.jpg saved to cache
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e
2026-01-28 17:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e, skipping ID generation
2026-01-28 17:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with scrape type 1
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e from tracking dictionaries
2026-01-28 17:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 185e91e6-91a2-5856-bde2-4e8ffc5cf36e sending to next pipeline
2026-01-28 17:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e, identifier: KX71919
2026-01-28 17:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with identifier: KX71919
2026-01-28 17:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with identifier: KX71919
2026-01-28 17:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 185e91e6-91a2-5856-bde2-4e8ffc5cf36e with identifier: KX71919 to the API
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_ec6bc065c85218100875f85b207b6652.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:29:00Z',
 'fuel_type': 'petrol',
 'id': '185e91e6-91a2-5856-bde2-4e8ffc5cf36e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX71919',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jeep',
 'model': 'Avenger',
 'odometer': 69496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272470,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c9460b281eb00ac51d3f8871ad8d4961.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272470,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_4625306da8d600ba5d578f93c16ddff3.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_384c1148826fc7c5e9581d663372e2e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232418,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_c076e07ae4ebd5fce3cecf23c1491849.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_bbeb93cecbe2d8f81c1ae483319af660.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255518,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_85d422c13f79265ab4b3eac2694f7110.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_7d9998e878753436554450e4beb87336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_538aba52b51cf8059f14d7874fe024d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195436,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_cd3fba25102383b7e5c2169f482c044c.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180231,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_96ec119ae01cb744df89a39fceacb371.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_86988f234086ad158b356eb4dc6b4b7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_f2de72966ecdc9b6e7d4dfe604c6b42f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_185e91e6-91a2-5856-bde2-4e8ffc5cf36e/185e91e6-91a2-5856-bde2-4e8ffc5cf36e_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110560,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge6/79/e679e53c836a59ec76d42df83bbfd199/pa/KX71919_ec6bc065c85218100875f85b207b6652.jpg',
             'Width': 2040}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Avenger 1.2 T-GDI Altitude',
 'transmission': 'manual',
 'trim': 'Altitude',
 'year': 2023}
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX71919%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [auto1.es] INFO: Saving data for KX71919: {'created_time': 1769619800.111734, 'last_price_update_time': 1769619800.111749, 'auction_closing_time': 1769704140.0}
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX71919') HTTP/1.1" 204 0
2026-01-28 17:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab92970-3c48-5023-9fde-90dcd7ba9de7 with identifier: ET29682
2026-01-28 17:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab92970-3c48-5023-9fde-90dcd7ba9de7 with scrape type 2
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab92970-3c48-5023-9fde-90dcd7ba9de7 with scrape type 2
2026-01-28 17:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dab92970-3c48-5023-9fde-90dcd7ba9de7, identifier: ET29682
2026-01-28 17:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a98f0ef-6921-5121-a66f-63c6395e3506 with identifier: PT57331
2026-01-28 17:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a98f0ef-6921-5121-a66f-63c6395e3506 with scrape type 1
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_34b1f71f4c66cd364f249543e94d86e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_34b1f71f4c66cd364f249543e94d86e1.jpg not downloaded yet
2026-01-28 17:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dab92970-3c48-5023-9fde-90dcd7ba9de7 with identifier: ET29682
2026-01-28 17:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dab92970-3c48-5023-9fde-90dcd7ba9de7 with identifier: ET29682
2026-01-28 17:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: dab92970-3c48-5023-9fde-90dcd7ba9de7 spider: auto1.es
2026-01-28 17:03:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dab92970-3c48-5023-9fde-90dcd7ba9de7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:56:56Z',
 'fuel_type': 'diesel',
 'id': 'dab92970-3c48-5023-9fde-90dcd7ba9de7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET29682',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 171495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ET29682%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [auto1.es] INFO: Saving data for ET29682: {'auction_closing_time': 1769705816.0, 'created_time': 1769061738.626079, 'last_price_update_time': 1769619800.487533}
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ET29682') HTTP/1.1" 204 0
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_fbc44b57aed7e237b3009b0713d26477.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_fbc44b57aed7e237b3009b0713d26477.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_6b690877ecc4c83b958293f3e85004bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_6b690877ecc4c83b958293f3e85004bb.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_79cf7976204164d413e37249d0148cd6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_79cf7976204164d413e37249d0148cd6.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_31ae20a3810f93889f928d7769650206.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_31ae20a3810f93889f928d7769650206.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_51d03df32b94ade769d1316d4f04137e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_51d03df32b94ade769d1316d4f04137e.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_b0f17901c4f046663a09c7e428286759.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b0f17901c4f046663a09c7e428286759.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_ad40554be37c188e92bac809cf45d4b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_ad40554be37c188e92bac809cf45d4b2.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_398ab2f2cdfc416a39e486304d6c664b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_398ab2f2cdfc416a39e486304d6c664b.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_bb480eded23e8ee024112b8847386de3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_bb480eded23e8ee024112b8847386de3.jpg not downloaded yet
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg not downloaded yet
2026-01-28 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP64804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AP34779> (referer: https://www.auto1.com/v1/car-details-view/AP34779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96afa2e4-4751-5789-a48a-38c859fdfe70 with identifier: AP34779
2026-01-28 17:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96afa2e4-4751-5789-a48a-38c859fdfe70 with scrape type 2
2026-01-28 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96afa2e4-4751-5789-a48a-38c859fdfe70 with scrape type 2
2026-01-28 17:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96afa2e4-4751-5789-a48a-38c859fdfe70, identifier: AP34779
2026-01-28 17:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96afa2e4-4751-5789-a48a-38c859fdfe70 with identifier: AP34779
2026-01-28 17:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96afa2e4-4751-5789-a48a-38c859fdfe70 with identifier: AP34779
2026-01-28 17:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 96afa2e4-4751-5789-a48a-38c859fdfe70 spider: auto1.es
2026-01-28 17:03:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 96afa2e4-4751-5789-a48a-38c859fdfe70 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:53Z',
 'fuel_type': 'diesel',
 'id': '96afa2e4-4751-5789-a48a-38c859fdfe70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP34779',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 90908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
 'transmission': 'automatic',
 'trim': 'Shine M',
 'year': 2019}
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AP34779%27 HTTP/1.1" 200 None
2026-01-28 17:03:21 [auto1.es] INFO: Saving data for AP34779: {'auction_closing_time': 1769703653.0, 'created_time': 1769518627.307355, 'last_price_update_time': 1769619801.363284}
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AP34779') HTTP/1.1" 204 0
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_bb480eded23e8ee024112b8847386de3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF97209/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL06212> (referer: https://www.auto1.com/v1/car-details-view/TL06212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN81981> (referer: https://www.auto1.com/v1/car-details-view/MN81981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA65804> (referer: https://www.auto1.com/v1/car-details-view/SA65804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_51d03df32b94ade769d1316d4f04137e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63698590>
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg saved to cache
2026-01-28 17:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_398ab2f2cdfc416a39e486304d6c664b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b0f17901c4f046663a09c7e428286759.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_ad40554be37c188e92bac809cf45d4b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344c910>
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_bb480eded23e8ee024112b8847386de3.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_bb480eded23e8ee024112b8847386de3.jpg saved to cache
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_31ae20a3810f93889f928d7769650206.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EG70285> (referer: https://www.auto1.com/v1/car-details-view/EG70285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69b2ee90-716b-53b0-90b3-b031d6d9182d with identifier: TL06212
2026-01-28 17:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b2ee90-716b-53b0-90b3-b031d6d9182d with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69b2ee90-716b-53b0-90b3-b031d6d9182d with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69b2ee90-716b-53b0-90b3-b031d6d9182d, identifier: TL06212
2026-01-28 17:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-01-28 17:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d405232d-9c8a-53bc-b902-53bf2a6a021c with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d405232d-9c8a-53bc-b902-53bf2a6a021c with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d405232d-9c8a-53bc-b902-53bf2a6a021c, identifier: MN81981
2026-01-28 17:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a9d1fd-6572-5af6-bc19-393e7a81d2db with identifier: SA65804
2026-01-28 17:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a9d1fd-6572-5af6-bc19-393e7a81d2db with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a9d1fd-6572-5af6-bc19-393e7a81d2db with scrape type 2
2026-01-28 17:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 99a9d1fd-6572-5af6-bc19-393e7a81d2db, identifier: SA65804
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bc550>
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_51d03df32b94ade769d1316d4f04137e.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_51d03df32b94ade769d1316d4f04137e.jpg saved to cache
2026-01-28 17:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69b2ee90-716b-53b0-90b3-b031d6d9182d with identifier: TL06212
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69b2ee90-716b-53b0-90b3-b031d6d9182d with identifier: TL06212
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178260
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 69b2ee90-716b-53b0-90b3-b031d6d9182d spider: auto1.es
2026-01-28 17:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 69b2ee90-716b-53b0-90b3-b031d6d9182d due to rule: high_mileage_for_country.json, error: 178260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178260
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:28:34Z',
 'fuel_type': 'petrol',
 'id': '69b2ee90-716b-53b0-90b3-b031d6d9182d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL06212',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 178260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL06212%27 HTTP/1.1" 200 None
2026-01-28 17:03:22 [auto1.es] INFO: Saving data for TL06212: {'auction_closing_time': 1769704114.0, 'created_time': 1769061751.484003, 'last_price_update_time': 1769619802.782013}
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TL06212') HTTP/1.1" 204 0
2026-01-28 17:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d405232d-9c8a-53bc-b902-53bf2a6a021c with identifier: MN81981
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172716
2026-01-28 17:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d405232d-9c8a-53bc-b902-53bf2a6a021c spider: auto1.es
2026-01-28 17:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d405232d-9c8a-53bc-b902-53bf2a6a021c due to rule: high_mileage_for_country.json, error: 172716 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172716
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:19:54Z',
 'fuel_type': 'diesel',
 'id': 'd405232d-9c8a-53bc-b902-53bf2a6a021c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN81981',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 172716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MN81981%27 HTTP/1.1" 200 None
2026-01-28 17:03:23 [auto1.es] INFO: Saving data for MN81981: {'auction_closing_time': 1769703594.0, 'created_time': 1769101547.771143, 'last_price_update_time': 1769619803.027538}
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MN81981') HTTP/1.1" 204 0
2026-01-28 17:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 99a9d1fd-6572-5af6-bc19-393e7a81d2db with identifier: SA65804
2026-01-28 17:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 99a9d1fd-6572-5af6-bc19-393e7a81d2db with identifier: SA65804
2026-01-28 17:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196684 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196684
2026-01-28 17:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 99a9d1fd-6572-5af6-bc19-393e7a81d2db spider: auto1.es
2026-01-28 17:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 99a9d1fd-6572-5af6-bc19-393e7a81d2db due to rule: high_mileage_for_country.json, error: 196684 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196684
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:07:50Z',
 'fuel_type': 'diesel',
 'id': '99a9d1fd-6572-5af6-bc19-393e7a81d2db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA65804',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 196684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2022}
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SA65804%27 HTTP/1.1" 200 None
2026-01-28 17:03:23 [auto1.es] INFO: Saving data for SA65804: {'auction_closing_time': 1769702870.0, 'created_time': 1769101348.821698, 'last_price_update_time': 1769619803.25084}
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SA65804') HTTP/1.1" 204 0
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635faa50>
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_398ab2f2cdfc416a39e486304d6c664b.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_398ab2f2cdfc416a39e486304d6c664b.jpg saved to cache
2026-01-28 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63503710>
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg saved to cache
2026-01-28 17:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629f9b10>
2026-01-28 17:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_b0f17901c4f046663a09c7e428286759.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b0f17901c4f046663a09c7e428286759.jpg saved to cache
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d1a90>
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_ad40554be37c188e92bac809cf45d4b2.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_ad40554be37c188e92bac809cf45d4b2.jpg saved to cache
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_79cf7976204164d413e37249d0148cd6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN45266> (referer: https://www.auto1.com/v1/car-details-view/KN45266/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6364d490>
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_31ae20a3810f93889f928d7769650206.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_31ae20a3810f93889f928d7769650206.jpg saved to cache
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f893e68-fe79-5a59-8a4f-5dcacb45594c with identifier: EG70285
2026-01-28 17:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f893e68-fe79-5a59-8a4f-5dcacb45594c with scrape type 2
2026-01-28 17:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f893e68-fe79-5a59-8a4f-5dcacb45594c with scrape type 2
2026-01-28 17:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f893e68-fe79-5a59-8a4f-5dcacb45594c, identifier: EG70285
2026-01-28 17:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA72623/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK81480> (referer: https://www.auto1.com/v1/car-details-view/LK81480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f893e68-fe79-5a59-8a4f-5dcacb45594c with identifier: EG70285
2026-01-28 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f893e68-fe79-5a59-8a4f-5dcacb45594c with identifier: EG70285
2026-01-28 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171594 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171594
2026-01-28 17:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0f893e68-fe79-5a59-8a4f-5dcacb45594c spider: auto1.es
2026-01-28 17:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0f893e68-fe79-5a59-8a4f-5dcacb45594c due to rule: high_mileage_for_country.json, error: 171594 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171594
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:13:12Z',
 'fuel_type': 'diesel',
 'id': '0f893e68-fe79-5a59-8a4f-5dcacb45594c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG70285',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 171594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2021}
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EG70285%27 HTTP/1.1" 200 None
2026-01-28 17:03:25 [auto1.es] INFO: Saving data for EG70285: {'auction_closing_time': 1769703192.0, 'created_time': 1769061760.696069, 'last_price_update_time': 1769619805.07012}
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EG70285') HTTP/1.1" 204 0
2026-01-28 17:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_6b690877ecc4c83b958293f3e85004bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW32457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6367ce50>
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg saved to cache
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291ef50>
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg saved to cache
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a53e10>
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg saved to cache
2026-01-28 17:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a55e50>
2026-01-28 17:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg saved to cache
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bc550>
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_79cf7976204164d413e37249d0148cd6.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_79cf7976204164d413e37249d0148cd6.jpg saved to cache
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-01-28 17:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b03e7-46a9-562f-bca7-f6469bf85e06 with scrape type 2
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b03e7-46a9-562f-bca7-f6469bf85e06 with scrape type 2
2026-01-28 17:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 382b03e7-46a9-562f-bca7-f6469bf85e06, identifier: KN45266
2026-01-28 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-01-28 17:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 382b03e7-46a9-562f-bca7-f6469bf85e06 with identifier: KN45266
2026-01-28 17:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191912 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191912
2026-01-28 17:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 382b03e7-46a9-562f-bca7-f6469bf85e06 spider: auto1.es
2026-01-28 17:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 382b03e7-46a9-562f-bca7-f6469bf85e06 due to rule: high_mileage_for_country.json, error: 191912 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191912
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:57:01Z',
 'fuel_type': 'diesel',
 'id': '382b03e7-46a9-562f-bca7-f6469bf85e06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN45266',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 191912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Equilibre',
 'transmission': 'manual',
 'trim': 'Equilibre',
 'year': 2023}
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN45266%27 HTTP/1.1" 200 None
2026-01-28 17:03:26 [auto1.es] INFO: Saving data for KN45266: {'auction_closing_time': 1769705821.0, 'created_time': 1769101598.860508, 'last_price_update_time': 1769619806.933061}
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN45266') HTTP/1.1" 204 0
2026-01-28 17:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with identifier: LK81480
2026-01-28 17:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with scrape type 1
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_c16166113355e198bd66ba37e256ac34.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_c16166113355e198bd66ba37e256ac34.jpg not downloaded yet
2026-01-28 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_34b1f71f4c66cd364f249543e94d86e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_fbc44b57aed7e237b3009b0713d26477.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UU16488> (referer: https://www.auto1.com/v1/car-details-view/UU16488/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XC93969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP76578> (referer: https://www.auto1.com/v1/car-details-view/MP76578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_9a5adc9378fefbead5be5068ee7d4191.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_9a5adc9378fefbead5be5068ee7d4191.jpg not downloaded yet
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e08d0>
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_6b690877ecc4c83b958293f3e85004bb.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_6b690877ecc4c83b958293f3e85004bb.jpg saved to cache
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_406ad9a2a58214520eac7e76b8371fb5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_406ad9a2a58214520eac7e76b8371fb5.jpg not downloaded yet
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_59d2646fdaa250dac8dd0774198e654a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_59d2646fdaa250dac8dd0774198e654a.jpg not downloaded yet
2026-01-28 17:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL45309> (referer: https://www.auto1.com/v1/car-details-view/FL45309/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634be990>
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_34b1f71f4c66cd364f249543e94d86e1.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_34b1f71f4c66cd364f249543e94d86e1.jpg saved to cache
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d4bd0>
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F7f%252F627f4788074fc1757368aba46796f751%252Fpa%252FPT57331_fbc44b57aed7e237b3009b0713d26477.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_fbc44b57aed7e237b3009b0713d26477.jpg saved to cache
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a98f0ef-6921-5121-a66f-63c6395e3506
2026-01-28 17:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a98f0ef-6921-5121-a66f-63c6395e3506, skipping ID generation
2026-01-28 17:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a98f0ef-6921-5121-a66f-63c6395e3506 with scrape type 1
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2a98f0ef-6921-5121-a66f-63c6395e3506 from tracking dictionaries
2026-01-28 17:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a98f0ef-6921-5121-a66f-63c6395e3506 sending to next pipeline
2026-01-28 17:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a98f0ef-6921-5121-a66f-63c6395e3506, identifier: PT57331
2026-01-28 17:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 with identifier: UU16488
2026-01-28 17:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 with scrape type 2
2026-01-28 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 with scrape type 2
2026-01-28 17:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46, identifier: UU16488
2026-01-28 17:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf9abc1f-765b-5b5a-8370-534d69682df2 with identifier: MP76578
2026-01-28 17:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf9abc1f-765b-5b5a-8370-534d69682df2 with scrape type 2
2026-01-28 17:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf9abc1f-765b-5b5a-8370-534d69682df2 with scrape type 2
2026-01-28 17:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bf9abc1f-765b-5b5a-8370-534d69682df2, identifier: MP76578
2026-01-28 17:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a98f0ef-6921-5121-a66f-63c6395e3506 with identifier: PT57331
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a98f0ef-6921-5121-a66f-63c6395e3506 with identifier: PT57331
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167881 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167881
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2a98f0ef-6921-5121-a66f-63c6395e3506 spider: auto1.es
2026-01-28 17:03:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2a98f0ef-6921-5121-a66f-63c6395e3506 due to rule: high_mileage_for_country.json, error: 167881 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167881
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:23:10Z',
 'fuel_type': 'diesel',
 'id': '2a98f0ef-6921-5121-a66f-63c6395e3506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT57331',
 'listing': 'auction',
 'location': 'ES, Cáceres',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 167881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_34b1f71f4c66cd364f249543e94d86e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_fbc44b57aed7e237b3009b0713d26477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_6b690877ecc4c83b958293f3e85004bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b64e25f365d00b4ed8a6c94a6ac4d816.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_79cf7976204164d413e37249d0148cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_01a43a3c8f99e6135b2ebb0636fb1322.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_8605630adf8b9b932d13c0a7f1d868d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_3cfe4e5c4311d7ed5b25fb20341ef03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_31ae20a3810f93889f928d7769650206.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_51d03df32b94ade769d1316d4f04137e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_b0f17901c4f046663a09c7e428286759.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_74c2405f5e08d8b5e84e092d65ca0814.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_ad40554be37c188e92bac809cf45d4b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45612,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_398ab2f2cdfc416a39e486304d6c664b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_bb480eded23e8ee024112b8847386de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a98f0ef-6921-5121-a66f-63c6395e3506/2a98f0ef-6921-5121-a66f-63c6395e3506_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/7f/627f4788074fc1757368aba46796f751/pa/PT57331_4b7a60a5ebe692cd2d1cf553c83c5fa8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2017}
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT57331%27 HTTP/1.1" 200 None
2026-01-28 17:03:28 [auto1.es] INFO: Saving data for PT57331: {'created_time': 1769619808.457158, 'last_price_update_time': 1769619808.45717, 'auction_closing_time': 1769703790.0}
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT57331') HTTP/1.1" 204 0
2026-01-28 17:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 with identifier: UU16488
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 with identifier: UU16488
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 spider: auto1.es
2026-01-28 17:03:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:22:12Z',
 'fuel_type': 'diesel',
 'id': '4f3fe3ee-1ebe-5dc9-bf45-e94bb2e4ab46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU16488',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 117327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Life Pack M',
 'transmission': 'manual',
 'trim': 'Life Pack M',
 'year': 2022}
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UU16488%27 HTTP/1.1" 200 None
2026-01-28 17:03:28 [auto1.es] INFO: Saving data for UU16488: {'auction_closing_time': 1769703732.0, 'created_time': 1769493631.443782, 'last_price_update_time': 1769619808.681644}
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UU16488') HTTP/1.1" 204 0
2026-01-28 17:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bf9abc1f-765b-5b5a-8370-534d69682df2 with identifier: MP76578
2026-01-28 17:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bf9abc1f-765b-5b5a-8370-534d69682df2 with identifier: MP76578
2026-01-28 17:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bf9abc1f-765b-5b5a-8370-534d69682df2 with identifier: MP76578 to the API
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP76578>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:17:49Z',
 'fuel_type': 'petrol',
 'id': 'bf9abc1f-765b-5b5a-8370-534d69682df2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP76578',
 'listing': 'auction',
 'location': 'ES, Gandía',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 55988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP76578%27 HTTP/1.1" 200 None
2026-01-28 17:03:28 [auto1.es] INFO: Saving data for MP76578: {'auction_closing_time': 1769703469.0, 'created_time': 1769002816.679862, 'last_price_update_time': 1769619808.997313}
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP76578') HTTP/1.1" 204 0
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg not downloaded yet
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_c16166113355e198bd66ba37e256ac34.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_d58e34137c5e4d22f8396119867a0a60.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_d58e34137c5e4d22f8396119867a0a60.jpg not downloaded yet
2026-01-28 17:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52cc5e06-f612-5ed3-83a0-10662b8229ca with identifier: FL45309
2026-01-28 17:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52cc5e06-f612-5ed3-83a0-10662b8229ca with scrape type 2
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52cc5e06-f612-5ed3-83a0-10662b8229ca with scrape type 2
2026-01-28 17:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 52cc5e06-f612-5ed3-83a0-10662b8229ca, identifier: FL45309
2026-01-28 17:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 52cc5e06-f612-5ed3-83a0-10662b8229ca with identifier: FL45309
2026-01-28 17:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 52cc5e06-f612-5ed3-83a0-10662b8229ca with identifier: FL45309
2026-01-28 17:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175830 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175830
2026-01-28 17:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 52cc5e06-f612-5ed3-83a0-10662b8229ca spider: auto1.es
2026-01-28 17:03:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 52cc5e06-f612-5ed3-83a0-10662b8229ca due to rule: high_mileage_for_country.json, error: 175830 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175830
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:24:35Z',
 'fuel_type': 'diesel',
 'id': '52cc5e06-f612-5ed3-83a0-10662b8229ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL45309',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 175830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FL45309%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [auto1.es] INFO: Saving data for FL45309: {'auction_closing_time': 1769703875.0, 'created_time': 1769061637.1427, 'last_price_update_time': 1769619809.356779}
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FL45309') HTTP/1.1" 204 0
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_73897da7c5137dd733b34ba8c2b4139f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_73897da7c5137dd733b34ba8c2b4139f.jpg not downloaded yet
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a11250>
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_c16166113355e198bd66ba37e256ac34.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_c16166113355e198bd66ba37e256ac34.jpg saved to cache
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg not downloaded yet
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_59d2646fdaa250dac8dd0774198e654a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg not downloaded yet
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_6c470bea754d2f42843aae16ef409ab9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_6c470bea754d2f42843aae16ef409ab9.jpg not downloaded yet
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM98135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg not downloaded yet
2026-01-28 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA12525> (referer: https://www.auto1.com/v1/car-details-view/PA12525/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg not downloaded yet
2026-01-28 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_74dc8e648c148ded6b9e577f3d475290.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_74dc8e648c148ded6b9e577f3d475290.jpg not downloaded yet
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL50046/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH94689> (referer: https://www.auto1.com/v1/car-details-view/LH94689/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_6c470bea754d2f42843aae16ef409ab9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP64804> (referer: https://www.auto1.com/v1/car-details-view/RP64804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF97209> (referer: https://www.auto1.com/v1/car-details-view/VF97209/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346ccd0>
2026-01-28 17:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_59d2646fdaa250dac8dd0774198e654a.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_59d2646fdaa250dac8dd0774198e654a.jpg saved to cache
2026-01-28 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d289d2a-390b-529c-b2bd-eccc2f094b0d with identifier: PA12525
2026-01-28 17:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d289d2a-390b-529c-b2bd-eccc2f094b0d with scrape type 2
2026-01-28 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d289d2a-390b-529c-b2bd-eccc2f094b0d with scrape type 2
2026-01-28 17:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d289d2a-390b-529c-b2bd-eccc2f094b0d, identifier: PA12525
2026-01-28 17:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d289d2a-390b-529c-b2bd-eccc2f094b0d with identifier: PA12525
2026-01-28 17:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d289d2a-390b-529c-b2bd-eccc2f094b0d with identifier: PA12525
2026-01-28 17:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d289d2a-390b-529c-b2bd-eccc2f094b0d with identifier: PA12525 to the API
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PA12525>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:00:58Z',
 'fuel_type': 'diesel',
 'id': '9d289d2a-390b-529c-b2bd-eccc2f094b0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA12525',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 60948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Plus',
 'transmission': 'manual',
 'trim': 'Plus',
 'year': 2023}
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA12525%27 HTTP/1.1" 200 None
2026-01-28 17:03:30 [auto1.es] INFO: Saving data for PA12525: {'auction_closing_time': 1769702458.0, 'created_time': 1769493629.087842, 'last_price_update_time': 1769619810.784958}
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA12525') HTTP/1.1" 204 0
2026-01-28 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_74dc8e648c148ded6b9e577f3d475290.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG12504/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA94679> (referer: https://www.auto1.com/v1/car-details-view/YA94679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 with identifier: LH94689
2026-01-28 17:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 with scrape type 2
2026-01-28 17:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 with scrape type 2
2026-01-28 17:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25, identifier: LH94689
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a66d10>
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg saved to cache
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b38d0>
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_6c470bea754d2f42843aae16ef409ab9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_6c470bea754d2f42843aae16ef409ab9.jpg saved to cache
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 with identifier: RP64804
2026-01-28 17:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 with scrape type 1
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg not downloaded yet
2026-01-28 17:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b1adbbd-b555-5584-a0cf-c040c15f4505 with identifier: VF97209
2026-01-28 17:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b1adbbd-b555-5584-a0cf-c040c15f4505 with scrape type 2
2026-01-28 17:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b1adbbd-b555-5584-a0cf-c040c15f4505 with scrape type 2
2026-01-28 17:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b1adbbd-b555-5584-a0cf-c040c15f4505, identifier: VF97209
2026-01-28 17:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 with identifier: LH94689
2026-01-28 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 with identifier: LH94689
2026-01-28 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146591 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146591
2026-01-28 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 spider: auto1.es
2026-01-28 17:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25 due to rule: high_mileage_for_make.json, error: 146591 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146591
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 255,
 'expiration_date': '2026-01-29T16:25:26Z',
 'fuel_type': 'diesel',
 'id': 'ef0bcd6a-7ec3-5387-8bb7-f59b89e4ce25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH94689',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Range Rover Sport',
 'odometer': 146591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Sport 3.0 TD V6 SDV6 HSE',
 'transmission': 'automatic',
 'trim': 'SDV6 HSE',
 'year': 2021}
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH94689%27 HTTP/1.1" 200 None
2026-01-28 17:03:31 [auto1.es] INFO: Saving data for LH94689: {'auction_closing_time': 1769703926.0, 'created_time': 1769493629.752181, 'last_price_update_time': 1769619811.845775}
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LH94689') HTTP/1.1" 204 0
2026-01-28 17:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b1adbbd-b555-5584-a0cf-c040c15f4505 with identifier: VF97209
2026-01-28 17:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b1adbbd-b555-5584-a0cf-c040c15f4505 with identifier: VF97209
2026-01-28 17:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1b1adbbd-b555-5584-a0cf-c040c15f4505 with identifier: VF97209 to the API
2026-01-28 17:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF97209>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:26:36Z',
 'fuel_type': 'diesel',
 'id': '1b1adbbd-b555-5584-a0cf-c040c15f4505',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF97209',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 111365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2021}
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF97209%27 HTTP/1.1" 200 None
2026-01-28 17:03:32 [auto1.es] INFO: Saving data for VF97209: {'auction_closing_time': 1769703996.0, 'created_time': 1769493627.919294, 'last_price_update_time': 1769619812.156193}
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF97209') HTTP/1.1" 204 0
2026-01-28 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg not downloaded yet
2026-01-28 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_73897da7c5137dd733b34ba8c2b4139f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC21611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR04177> (referer: https://www.auto1.com/v1/car-details-view/BR04177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62acf590>
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg saved to cache
2026-01-28 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a54910>
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_74dc8e648c148ded6b9e577f3d475290.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_74dc8e648c148ded6b9e577f3d475290.jpg saved to cache
2026-01-28 17:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63470510>
2026-01-28 17:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg saved to cache
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2026-01-28 17:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a7c8ad0-0085-587a-b001-317cc3af5be1 with scrape type 2
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a7c8ad0-0085-587a-b001-317cc3af5be1 with scrape type 2
2026-01-28 17:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a7c8ad0-0085-587a-b001-317cc3af5be1, identifier: YA94679
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_8b08138f9e9a0a29e117ac90d1479124.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_8b08138f9e9a0a29e117ac90d1479124.jpg not downloaded yet
2026-01-28 17:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2026-01-28 17:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 with identifier: YA94679
2026-01-28 17:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185449
2026-01-28 17:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3a7c8ad0-0085-587a-b001-317cc3af5be1 spider: auto1.es
2026-01-28 17:03:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3a7c8ad0-0085-587a-b001-317cc3af5be1 due to rule: high_mileage_for_country.json, error: 185449 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185449
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:35:15Z',
 'fuel_type': 'petrol',
 'id': '3a7c8ad0-0085-587a-b001-317cc3af5be1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA94679',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 185449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA94679%27 HTTP/1.1" 200 None
2026-01-28 17:03:33 [auto1.es] INFO: Saving data for YA94679: {'auction_closing_time': 1769704515.0, 'created_time': 1769003353.959385, 'last_price_update_time': 1769619813.444097}
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YA94679') HTTP/1.1" 204 0
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_d58e34137c5e4d22f8396119867a0a60.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_406ad9a2a58214520eac7e76b8371fb5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_9a5adc9378fefbead5be5068ee7d4191.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_edf3d4857b91d6288d6f6f93515a8447.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_edf3d4857b91d6288d6f6f93515a8447.jpg not downloaded yet
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM54288/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA72623> (referer: https://www.auto1.com/v1/car-details-view/MA72623/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE25563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD18994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62967c50>
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg saved to cache
2026-01-28 17:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634ab210>
2026-01-28 17:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_73897da7c5137dd733b34ba8c2b4139f.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_73897da7c5137dd733b34ba8c2b4139f.jpg saved to cache
2026-01-28 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with identifier: BR04177
2026-01-28 17:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with scrape type 2
2026-01-28 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with scrape type 2
2026-01-28 17:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d, identifier: BR04177
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg not downloaded yet
2026-01-28 17:03:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with identifier: BR04177
2026-01-28 17:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with identifier: BR04177
2026-01-28 17:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d with identifier: BR04177 to the API
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR04177>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 280,
 'expiration_date': '2026-01-29T16:58:34Z',
 'fuel_type': 'hybrid',
 'id': 'ce3b5938-4b29-51df-ae48-1b7e4a8b6b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR04177',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Alfa Romeo',
 'model': 'Tonale',
 'odometer': 38604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Tonale 1.3 Plug-in Hybrid Veloce AWD',
 'transmission': 'automatic',
 'trim': 'Veloce AWD',
 'year': 2023}
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR04177%27 HTTP/1.1" 200 None
2026-01-28 17:03:34 [auto1.es] INFO: Saving data for BR04177: {'auction_closing_time': 1769705914.0, 'created_time': 1766077233.608817, 'last_price_update_time': 1769619814.946079}
2026-01-28 17:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR04177') HTTP/1.1" 204 0
2026-01-28 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg not downloaded yet
2026-01-28 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XC93969> (referer: https://www.auto1.com/v1/car-details-view/XC93969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL50046> (referer: https://www.auto1.com/v1/car-details-view/KL50046/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_8b08138f9e9a0a29e117ac90d1479124.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629aff90>
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg saved to cache
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290c510>
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_d58e34137c5e4d22f8396119867a0a60.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_d58e34137c5e4d22f8396119867a0a60.jpg saved to cache
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ac410>
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_406ad9a2a58214520eac7e76b8371fb5.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_406ad9a2a58214520eac7e76b8371fb5.jpg saved to cache
2026-01-28 17:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629d4810>
2026-01-28 17:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb6%252F1d%252Fb61db242ca38a296f4fa693fa3847944%252Fpa%252FLK81480_9a5adc9378fefbead5be5068ee7d4191.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_9a5adc9378fefbead5be5068ee7d4191.jpg saved to cache
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0
2026-01-28 17:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0, skipping ID generation
2026-01-28 17:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with scrape type 1
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 from tracking dictionaries
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 sending to next pipeline
2026-01-28 17:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0, identifier: LK81480
2026-01-28 17:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with identifier: MA72623
2026-01-28 17:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with scrape type 2
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with scrape type 2
2026-01-28 17:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf, identifier: MA72623
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636bc910>
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg saved to cache
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_38b4029fa6f86273a6180f09778b4722.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_38b4029fa6f86273a6180f09778b4722.jpg not downloaded yet
2026-01-28 17:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with identifier: LK81480
2026-01-28 17:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with identifier: LK81480
2026-01-28 17:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0cc75b66-725c-53a6-b4ea-d4d1b74b72d0 with identifier: LK81480 to the API
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_9a5adc9378fefbead5be5068ee7d4191.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:02:07Z',
 'fuel_type': 'petrol',
 'id': '0cc75b66-725c-53a6-b4ea-d4d1b74b72d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK81480',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 59404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_c16166113355e198bd66ba37e256ac34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_9a5adc9378fefbead5be5068ee7d4191.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_406ad9a2a58214520eac7e76b8371fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203660,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_59d2646fdaa250dac8dd0774198e654a.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203660,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7e2a3eaed50ed1c35804987c7b3778b5.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205291,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_d58e34137c5e4d22f8396119867a0a60.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_73897da7c5137dd733b34ba8c2b4139f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220289,
             'Height': 1500,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_7c83d6262bb89b8825105e2d2d6e122b.jpg',
             'Width': 2000},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 226845,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_b8d41c04147385d1aa595c4733c6c3d3.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_6c470bea754d2f42843aae16ef409ab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_68e75c7dafcfd075cc69ece87f2ea6d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179056,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_62d590b545f15b161dbe28b9cbe8f5aa.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc75b66-725c-53a6-b4ea-d4d1b74b72d0/0cc75b66-725c-53a6-b4ea-d4d1b74b72d0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb6/1d/b61db242ca38a296f4fa693fa3847944/pa/LK81480_74dc8e648c148ded6b9e577f3d475290.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK81480%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [auto1.es] INFO: Saving data for LK81480: {'created_time': 1769619817.07744, 'last_price_update_time': 1769619817.077451, 'auction_closing_time': 1769702527.0}
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK81480') HTTP/1.1" 204 0
2026-01-28 17:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with identifier: MA72623
2026-01-28 17:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with identifier: MA72623
2026-01-28 17:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42ba82bb-bb46-50f7-b8c4-9f74a7378fcf with identifier: MA72623 to the API
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MA72623>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:48:07Z',
 'fuel_type': 'diesel',
 'id': '42ba82bb-bb46-50f7-b8c4-9f74a7378fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA72623',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 73047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA72623%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [auto1.es] INFO: Saving data for MA72623: {'auction_closing_time': 1769705287.0, 'created_time': 1769002663.382768, 'last_price_update_time': 1769619817.401227}
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA72623') HTTP/1.1" 204 0
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_2d2ef6239553b10b2a110a853e16fea9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_2d2ef6239553b10b2a110a853e16fea9.jpg not downloaded yet
2026-01-28 17:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW32457> (referer: https://www.auto1.com/v1/car-details-view/SW32457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM98135> (referer: https://www.auto1.com/v1/car-details-view/VM98135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6ad50>
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg saved to cache
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23aa7b3f-5e50-56e1-838a-412dfa98d9e7 with identifier: XC93969
2026-01-28 17:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23aa7b3f-5e50-56e1-838a-412dfa98d9e7 with scrape type 1
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 23aa7b3f-5e50-56e1-838a-412dfa98d9e7
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_5d3bcba7af907720e84aa31af5f3d256.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_5d3bcba7af907720e84aa31af5f3d256.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_ac5d5173856ac45de408463a2f09036d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_ac5d5173856ac45de408463a2f09036d.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_c4f0fad61e0a23aa386c3b13add74c41.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_c4f0fad61e0a23aa386c3b13add74c41.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_9b3e3e22310c61568ec2af96ddeada0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_9b3e3e22310c61568ec2af96ddeada0a.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_dc44eeda095cbff9e4dfd799abb35ee2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_dc44eeda095cbff9e4dfd799abb35ee2.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_6f32c8b892e48b800dd04a4a20ea4b4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6f32c8b892e48b800dd04a4a20ea4b4c.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_3451faa84854019024ce2c3ff0b37d0b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_3451faa84854019024ce2c3ff0b37d0b.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_0aa4cae346055be9d96f93bccdbf6ab7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_0aa4cae346055be9d96f93bccdbf6ab7.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_e0b0260c56d5894a7813aaffecbc8217.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_e0b0260c56d5894a7813aaffecbc8217.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_b832dca5989a773b61b1dda9d468dff4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_b832dca5989a773b61b1dda9d468dff4.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_565128ab3b917286c18f690a4da480ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_565128ab3b917286c18f690a4da480ea.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_4384fa75af1bc77df45bd194d6b4efe4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_4384fa75af1bc77df45bd194d6b4efe4.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_976518c47ecea7bc3a03891e4b2fa6cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_976518c47ecea7bc3a03891e4b2fa6cb.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_7c1bce9e78b26560e42958736cf9d63e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_7c1bce9e78b26560e42958736cf9d63e.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_035a64344295d206cc3b53a46c73efa4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_035a64344295d206cc3b53a46c73efa4.jpg already downloaded
2026-01-28 17:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F4c%252F7b4caf91ae417c28d6962cf1a3878339%252Fpa%252FXC93969_6efaeb67c86df83de32780474498bb04.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6efaeb67c86df83de32780474498bb04.jpg already downloaded
2026-01-28 17:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23aa7b3f-5e50-56e1-838a-412dfa98d9e7, identifier: XC93969
2026-01-28 17:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a220510b-1967-5aec-af64-1b8688a00684 with identifier: KL50046
2026-01-28 17:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a220510b-1967-5aec-af64-1b8688a00684 with scrape type 2
2026-01-28 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a220510b-1967-5aec-af64-1b8688a00684 with scrape type 2
2026-01-28 17:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a220510b-1967-5aec-af64-1b8688a00684, identifier: KL50046
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a57a90>
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_8b08138f9e9a0a29e117ac90d1479124.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_8b08138f9e9a0a29e117ac90d1479124.jpg saved to cache
2026-01-28 17:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23aa7b3f-5e50-56e1-838a-412dfa98d9e7 with identifier: XC93969
2026-01-28 17:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23aa7b3f-5e50-56e1-838a-412dfa98d9e7 with identifier: XC93969
2026-01-28 17:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 23aa7b3f-5e50-56e1-838a-412dfa98d9e7 with identifier: XC93969 to the API
2026-01-28 17:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XC93969>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 194,
 'expiration_date': '2026-01-29T16:34:53Z',
 'fuel_type': 'diesel',
 'id': '23aa7b3f-5e50-56e1-838a-412dfa98d9e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC93969',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 65186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_5d3bcba7af907720e84aa31af5f3d256.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_ac5d5173856ac45de408463a2f09036d.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_c4f0fad61e0a23aa386c3b13add74c41.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_9b3e3e22310c61568ec2af96ddeada0a.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_dc44eeda095cbff9e4dfd799abb35ee2.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6f32c8b892e48b800dd04a4a20ea4b4c.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_3451faa84854019024ce2c3ff0b37d0b.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_0aa4cae346055be9d96f93bccdbf6ab7.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_e0b0260c56d5894a7813aaffecbc8217.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_b832dca5989a773b61b1dda9d468dff4.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_565128ab3b917286c18f690a4da480ea.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_4384fa75af1bc77df45bd194d6b4efe4.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_976518c47ecea7bc3a03891e4b2fa6cb.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_7c1bce9e78b26560e42958736cf9d63e.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_035a64344295d206cc3b53a46c73efa4.jpg',
                'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6efaeb67c86df83de32780474498bb04.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_5d3bcba7af907720e84aa31af5f3d256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_ac5d5173856ac45de408463a2f09036d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_c4f0fad61e0a23aa386c3b13add74c41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_9b3e3e22310c61568ec2af96ddeada0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_dc44eeda095cbff9e4dfd799abb35ee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6f32c8b892e48b800dd04a4a20ea4b4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_3451faa84854019024ce2c3ff0b37d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_0aa4cae346055be9d96f93bccdbf6ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_e0b0260c56d5894a7813aaffecbc8217.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_b832dca5989a773b61b1dda9d468dff4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_565128ab3b917286c18f690a4da480ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_4384fa75af1bc77df45bd194d6b4efe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_976518c47ecea7bc3a03891e4b2fa6cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_7c1bce9e78b26560e42958736cf9d63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_035a64344295d206cc3b53a46c73efa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23aa7b3f-5e50-56e1-838a-412dfa98d9e7/23aa7b3f-5e50-56e1-838a-412dfa98d9e7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/4c/7b4caf91ae417c28d6962cf1a3878339/pa/XC93969_6efaeb67c86df83de32780474498bb04.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XC93969%27 HTTP/1.1" 200 None
2026-01-28 17:03:39 [auto1.es] INFO: Saving data for XC93969: {'created_time': 1769619819.701161, 'last_price_update_time': 1769619819.701172, 'auction_closing_time': 1769704493.0}
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XC93969') HTTP/1.1" 204 0
2026-01-28 17:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a220510b-1967-5aec-af64-1b8688a00684 with identifier: KL50046
2026-01-28 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a220510b-1967-5aec-af64-1b8688a00684 with identifier: KL50046
2026-01-28 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 puretech origins', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 101561, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl50046', 'expiration_date': '2026-01-29t16:07:12z', 'origin_country_code': 'es', 'trim': 'origins', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, pedrola, zaragoza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'a220510b-1967-5aec-af64-1b8688a00684', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 101561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:07:12z',
     'fuel_type': 'petrol',
     'id': 'a220510b-1967-5aec-af64-1b8688a00684',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl50046',
     'listing': 'auction',
     'location': 'es, pedrola, zaragoza',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 101561,
     'odometer_in_km': 101561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 puretech origins',
     'transmission': 'automatic',
     'trim': 'origins',
     'year': 2019}
2026-01-28 17:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a220510b-1967-5aec-af64-1b8688a00684 spider: auto1.es
2026-01-28 17:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a220510b-1967-5aec-af64-1b8688a00684 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c4 cactus 1.2 puretech origins', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c4 cactus', 'transmission': 'automatic', 'odometer': 101561, 'odometer_reading_unit': 'km', 'registration_date': '2019-06-18', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl50046', 'expiration_date': '2026-01-29t16:07:12z', 'origin_country_code': 'es', 'trim': 'origins', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, pedrola, zaragoza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 117, 'id': 'a220510b-1967-5aec-af64-1b8688a00684', 'current_year_diff': 7, 'age_in_months': 79, 'make_model': 'citroen c4 cactus', 'sanitized_make': 'citroen', 'odometer_in_km': 101561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 79,
     'auction_title': '',
     'c_o_2_emission_value': 117,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:07:12z',
     'fuel_type': 'petrol',
     'id': 'a220510b-1967-5aec-af64-1b8688a00684',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/kl50046',
     'listing': 'auction',
     'location': 'es, pedrola, zaragoza',
     'make': 'citroen',
     'make_model': 'citroen c4 cactus',
     'model': 'c4 cactus',
     'odometer': 101561,
     'odometer_in_km': 101561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-06-18',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c4 cactus 1.2 puretech origins',
     'transmission': 'automatic',
     'trim': 'origins',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:07:12Z',
 'fuel_type': 'petrol',
 'id': 'a220510b-1967-5aec-af64-1b8688a00684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL50046',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 101561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 PureTech Origins',
 'transmission': 'automatic',
 'trim': 'Origins',
 'year': 2019}
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL50046%27 HTTP/1.1" 200 None
2026-01-28 17:03:39 [auto1.es] INFO: Saving data for KL50046: {'auction_closing_time': 1769702832.0, 'created_time': 1767703508.997727, 'last_price_update_time': 1769619819.933176}
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL50046') HTTP/1.1" 204 0
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3946a1490e11eb1483af42761d8954e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3946a1490e11eb1483af42761d8954e2.jpg not downloaded yet
2026-01-28 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_edf3d4857b91d6288d6f6f93515a8447.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD77535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG12504> (referer: https://www.auto1.com/v1/car-details-view/BG12504/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS45210/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD56270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563c563e-6d3c-56a6-987a-c5e4906c0715 with identifier: SW32457
2026-01-28 17:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c563e-6d3c-56a6-987a-c5e4906c0715 with scrape type 1
2026-01-28 17:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_d061d3611dcf3c7234252c85417d044c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_d061d3611dcf3c7234252c85417d044c.jpg not downloaded yet
2026-01-28 17:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with identifier: VM98135
2026-01-28 17:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with scrape type 2
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with scrape type 2
2026-01-28 17:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c93311e-7580-5eda-bb93-ed1fb17ef9dc, identifier: VM98135
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg not downloaded yet
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with identifier: VM98135
2026-01-28 17:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with identifier: VM98135
2026-01-28 17:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c93311e-7580-5eda-bb93-ed1fb17ef9dc with identifier: VM98135 to the API
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM98135>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 71,
 'expiration_date': '2026-01-29T16:38:00Z',
 'fuel_type': 'petrol',
 'id': '7c93311e-7580-5eda-bb93-ed1fb17ef9dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM98135',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 23869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Kaiteki',
 'transmission': 'manual',
 'trim': 'Kaiteki',
 'year': 2023}
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM98135%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [auto1.es] INFO: Saving data for VM98135: {'auction_closing_time': 1769704680.0, 'created_time': 1769014863.080193, 'last_price_update_time': 1769619820.459}
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VM98135') HTTP/1.1" 204 0
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289a890>
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg saved to cache
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_9e88145d19bb315cc7434e125aab730a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9e88145d19bb315cc7434e125aab730a.jpg not downloaded yet
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg not downloaded yet
2026-01-28 17:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC06310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TL86494/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_38b4029fa6f86273a6180f09778b4722.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_a07a2b927445cdb7f41be7da8573023d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a07a2b927445cdb7f41be7da8573023d.jpg not downloaded yet
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a74910>
2026-01-28 17:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_edf3d4857b91d6288d6f6f93515a8447.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_edf3d4857b91d6288d6f6f93515a8447.jpg saved to cache
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d22af3-832a-552d-b98f-a732b842c8ff with identifier: BG12504
2026-01-28 17:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d22af3-832a-552d-b98f-a732b842c8ff with scrape type 2
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d22af3-832a-552d-b98f-a732b842c8ff with scrape type 2
2026-01-28 17:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 92d22af3-832a-552d-b98f-a732b842c8ff, identifier: BG12504
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg not downloaded yet
2026-01-28 17:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 92d22af3-832a-552d-b98f-a732b842c8ff with identifier: BG12504
2026-01-28 17:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 92d22af3-832a-552d-b98f-a732b842c8ff with identifier: BG12504
2026-01-28 17:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 92d22af3-832a-552d-b98f-a732b842c8ff with identifier: BG12504 to the API
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG12504>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 272,
 'expiration_date': '2026-01-29T16:44:47Z',
 'fuel_type': 'electro',
 'id': '92d22af3-832a-552d-b98f-a732b842c8ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG12504',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'EX30',
 'odometer': 3825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo EX30 Single Motor Plus 2WD',
 'transmission': 'automatic',
 'trim': 'Plus 2WD',
 'year': 2024}
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG12504%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [auto1.es] INFO: Saving data for BG12504: {'auction_closing_time': 1769705087.0, 'created_time': 1767978159.757617, 'last_price_update_time': 1769619821.497123}
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG12504') HTTP/1.1" 204 0
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg not downloaded yet
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_2d2ef6239553b10b2a110a853e16fea9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3946a1490e11eb1483af42761d8954e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_9e79a687e5d95c9c7ebe93757e537649.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_9e79a687e5d95c9c7ebe93757e537649.jpg not downloaded yet
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6298f850>
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_38b4029fa6f86273a6180f09778b4722.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_38b4029fa6f86273a6180f09778b4722.jpg saved to cache
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_97a005bd553d0f9df6888bfe5675ef39.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_97a005bd553d0f9df6888bfe5675ef39.jpg not downloaded yet
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3eda720472a39f8cf208aabca9ef6f80.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3eda720472a39f8cf208aabca9ef6f80.jpg not downloaded yet
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_d061d3611dcf3c7234252c85417d044c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9e88145d19bb315cc7434e125aab730a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_917699508d8b7873a0754a55648e6fc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_917699508d8b7873a0754a55648e6fc5.jpg not downloaded yet
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636571d0>
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_2d2ef6239553b10b2a110a853e16fea9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_2d2ef6239553b10b2a110a853e16fea9.jpg saved to cache
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62919d50>
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3946a1490e11eb1483af42761d8954e2.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3946a1490e11eb1483af42761d8954e2.jpg saved to cache
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634eb750>
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg saved to cache
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_f6da53854b390984670145b9a8d1643e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_f6da53854b390984670145b9a8d1643e.jpg not downloaded yet
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_883214431a84eb5dde86e33aebdd864a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_883214431a84eb5dde86e33aebdd864a.jpg not downloaded yet
2026-01-28 17:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg not downloaded yet
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629fa250>
2026-01-28 17:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_d061d3611dcf3c7234252c85417d044c.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_d061d3611dcf3c7234252c85417d044c.jpg saved to cache
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a07b90>
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg saved to cache
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6345ff50>
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_9e88145d19bb315cc7434e125aab730a.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9e88145d19bb315cc7434e125aab730a.jpg saved to cache
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg not downloaded yet
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE25563> (referer: https://www.auto1.com/v1/car-details-view/GE25563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD18994> (referer: https://www.auto1.com/v1/car-details-view/YD18994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_97a005bd553d0f9df6888bfe5675ef39.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg not downloaded yet
2026-01-28 17:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK77836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN49784/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW09028/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK49893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357b6d0>
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg saved to cache
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg not downloaded yet
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC21611> (referer: https://www.auto1.com/v1/car-details-view/YC21611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_f6da53854b390984670145b9a8d1643e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7723ddb-161a-5917-8885-edee46238869 with identifier: GE25563
2026-01-28 17:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7723ddb-161a-5917-8885-edee46238869 with scrape type 1
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg not downloaded yet
2026-01-28 17:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 420ad18b-eded-5a0b-8541-c53c949ee30c with identifier: YD18994
2026-01-28 17:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 420ad18b-eded-5a0b-8541-c53c949ee30c with scrape type 2
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 420ad18b-eded-5a0b-8541-c53c949ee30c with scrape type 2
2026-01-28 17:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 420ad18b-eded-5a0b-8541-c53c949ee30c, identifier: YD18994
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634eb9d0>
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_97a005bd553d0f9df6888bfe5675ef39.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_97a005bd553d0f9df6888bfe5675ef39.jpg saved to cache
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_39baf523e56a42bc4c672b900b6d4199.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_39baf523e56a42bc4c672b900b6d4199.jpg not downloaded yet
2026-01-28 17:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 420ad18b-eded-5a0b-8541-c53c949ee30c with identifier: YD18994
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-01-28 17:03:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-01-28 17:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 420ad18b-eded-5a0b-8541-c53c949ee30c with identifier: YD18994
2026-01-28 17:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 420ad18b-eded-5a0b-8541-c53c949ee30c with identifier: YD18994 to the API
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD18994>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:57:00Z',
 'fuel_type': 'electro',
 'id': '420ad18b-eded-5a0b-8541-c53c949ee30c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD18994',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': '5 E-Tech',
 'odometer': 8725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault 5 E-Tech electric drive 110 kW Comfort Range Techno',
 'transmission': 'automatic',
 'trim': 'Comfort Range Techno',
 'year': 2025}
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD18994%27 HTTP/1.1" 200 None
2026-01-28 17:03:44 [auto1.es] INFO: Saving data for YD18994: {'auction_closing_time': 1769705820.0, 'created_time': 1768475086.34942, 'last_price_update_time': 1769619824.947445}
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD18994') HTTP/1.1" 204 0
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_883214431a84eb5dde86e33aebdd864a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_a54ed683be6202c77132f4fce6af878c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_a54ed683be6202c77132f4fce6af878c.jpg not downloaded yet
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3eda720472a39f8cf208aabca9ef6f80.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_917699508d8b7873a0754a55648e6fc5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_9e79a687e5d95c9c7ebe93757e537649.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg not downloaded yet
2026-01-28 17:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57635d99-fd19-5476-8521-5ef4619ca7e5 with identifier: YC21611
2026-01-28 17:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57635d99-fd19-5476-8521-5ef4619ca7e5 with scrape type 1
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_f36347bcd96568785ce47320202a8b66.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f36347bcd96568785ce47320202a8b66.jpg not downloaded yet
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aad810>
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_f6da53854b390984670145b9a8d1643e.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_f6da53854b390984670145b9a8d1643e.jpg saved to cache
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_8bddce08a5726663eeb2a2231ef756f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8bddce08a5726663eeb2a2231ef756f3.jpg not downloaded yet
2026-01-28 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF01529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg not downloaded yet
2026-01-28 17:03:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg not downloaded yet
2026-01-28 17:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg not downloaded yet
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629db1d0>
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_883214431a84eb5dde86e33aebdd864a.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_883214431a84eb5dde86e33aebdd864a.jpg saved to cache
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633c30d0>
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg saved to cache
2026-01-28 17:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63649f90>
2026-01-28 17:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg saved to cache
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e0650>
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_3eda720472a39f8cf208aabca9ef6f80.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3eda720472a39f8cf208aabca9ef6f80.jpg saved to cache
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6280b5d0>
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_917699508d8b7873a0754a55648e6fc5.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_917699508d8b7873a0754a55648e6fc5.jpg saved to cache
2026-01-28 17:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a64690>
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_9e79a687e5d95c9c7ebe93757e537649.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_9e79a687e5d95c9c7ebe93757e537649.jpg saved to cache
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c0650>
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg saved to cache
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg not downloaded yet
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg not downloaded yet
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_9c7848d145a4c34553c662df4acef9e9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_9c7848d145a4c34553c662df4acef9e9.jpg not downloaded yet
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_39baf523e56a42bc4c672b900b6d4199.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cc31656b91b99b957b706086f044bdd0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cc31656b91b99b957b706086f044bdd0.jpg not downloaded yet
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_69cc9f28b99e6654277f81a991f287b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_69cc9f28b99e6654277f81a991f287b6.jpg not downloaded yet
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TL86494> (referer: https://www.auto1.com/v1/car-details-view/TL86494/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD77535> (referer: https://www.auto1.com/v1/car-details-view/KD77535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD56270> (referer: https://www.auto1.com/v1/car-details-view/ZD56270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS45210> (referer: https://www.auto1.com/v1/car-details-view/DS45210/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC06310> (referer: https://www.auto1.com/v1/car-details-view/CC06310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM54288> (referer: https://www.auto1.com/v1/car-details-view/DM54288/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c2890>
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg saved to cache
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f36347bcd96568785ce47320202a8b66.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg not downloaded yet
2026-01-28 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8bddce08a5726663eeb2a2231ef756f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cffd915d00388d0300e2bc1b126f5968.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cffd915d00388d0300e2bc1b126f5968.jpg not downloaded yet
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_688afcfb8f205103052376e91b84ce1a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_688afcfb8f205103052376e91b84ce1a.jpg not downloaded yet
2026-01-28 17:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_96c34b1daf1571abd6dacfed36569327.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_96c34b1daf1571abd6dacfed36569327.jpg not downloaded yet
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ae4d0>
2026-01-28 17:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg saved to cache
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627df850>
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg saved to cache
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62734610>
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_39baf523e56a42bc4c672b900b6d4199.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_39baf523e56a42bc4c672b900b6d4199.jpg saved to cache
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b with identifier: TL86494
2026-01-28 17:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b with scrape type 2
2026-01-28 17:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b with scrape type 2
2026-01-28 17:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b, identifier: TL86494
2026-01-28 17:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef43cbb0-45d2-53e5-bdbc-4528bc365e5c with identifier: KD77535
2026-01-28 17:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef43cbb0-45d2-53e5-bdbc-4528bc365e5c with scrape type 1
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ef43cbb0-45d2-53e5-bdbc-4528bc365e5c
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_6e6e63890be8f359afb91acc102c7730.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_6e6e63890be8f359afb91acc102c7730.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_d92e9f7589eb3079d6a5e5bd964981ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_d92e9f7589eb3079d6a5e5bd964981ea.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_5663aaa46fa9d1f72191bbce9014d69d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5663aaa46fa9d1f72191bbce9014d69d.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_5334ade11e6b733e5e206cd42c3c4cd6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5334ade11e6b733e5e206cd42c3c4cd6.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_dc054f055c742f3226bdf4486bddc155.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_dc054f055c742f3226bdf4486bddc155.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_212bd9d9909bbf0edec99130289616a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_212bd9d9909bbf0edec99130289616a0.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_bca6cbdbf1e122f3efbae21a18d5faf1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bca6cbdbf1e122f3efbae21a18d5faf1.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_1af14e08d027245c1f572f3b0bba9ebf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1af14e08d027245c1f572f3b0bba9ebf.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_353171ef71373c1da9386107fc46e336.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_353171ef71373c1da9386107fc46e336.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_56a526d7f0b7ab6cc82f93da0abdc31d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_56a526d7f0b7ab6cc82f93da0abdc31d.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_f2a6d461dd43124750fbdde2e1d01521.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_f2a6d461dd43124750fbdde2e1d01521.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_5a2778ac22259d44aa949609528a26ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5a2778ac22259d44aa949609528a26ef.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_b0c0b671c0861b18418d95356e692329.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_b0c0b671c0861b18418d95356e692329.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_bce604e2721522fa397302fe326b2324.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bce604e2721522fa397302fe326b2324.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_1994c127deaa3435dd895efda61e8008.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1994c127deaa3435dd895efda61e8008.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F80%252Fb8809c0e32c3a424fb2255d94f2d08fd%252Fpa%252FKD77535_e2d9a29d8e6ebfeafc3d5c2056996815.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_e2d9a29d8e6ebfeafc3d5c2056996815.jpg already downloaded
2026-01-28 17:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ef43cbb0-45d2-53e5-bdbc-4528bc365e5c, identifier: KD77535
2026-01-28 17:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4252738a-07a5-59df-ab34-c9f6f8b2155b with identifier: ZD56270
2026-01-28 17:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4252738a-07a5-59df-ab34-c9f6f8b2155b with scrape type 2
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4252738a-07a5-59df-ab34-c9f6f8b2155b with scrape type 2
2026-01-28 17:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4252738a-07a5-59df-ab34-c9f6f8b2155b, identifier: ZD56270
2026-01-28 17:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aec6147c-8aca-5d20-818f-f53f75f806c8 with identifier: DS45210
2026-01-28 17:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aec6147c-8aca-5d20-818f-f53f75f806c8 with scrape type 1
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item aec6147c-8aca-5d20-818f-f53f75f806c8
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_f2ab544ce51cb4894c723c26f9ee7d11.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_f2ab544ce51cb4894c723c26f9ee7d11.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_0d5b0dbc9d7237e523255a930b168ea5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0d5b0dbc9d7237e523255a930b168ea5.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_0366a40d7c84128638866576d725c245.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0366a40d7c84128638866576d725c245.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_0cb06e2dbc79a4667897a7356fa3e890.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0cb06e2dbc79a4667897a7356fa3e890.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_ca367fe7b67ad8b10c005ac035ff580d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_ca367fe7b67ad8b10c005ac035ff580d.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_4a25479901c05b54cf35a67bf8be0b7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_4a25479901c05b54cf35a67bf8be0b7b.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_681c95c58a703bf81b280b52e502689a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_681c95c58a703bf81b280b52e502689a.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_9a1845474e047f144a44399a9615d4e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_9a1845474e047f144a44399a9615d4e2.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_d77e37e59c4233429c9366e7237c60c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_d77e37e59c4233429c9366e7237c60c3.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_b226cd0dbb97971c670aff59a9d9f5b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b226cd0dbb97971c670aff59a9d9f5b4.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_3357622bdd18b20277f40c966bcc3192.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_3357622bdd18b20277f40c966bcc3192.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_83570d20435b09bd92b053bc6db15839.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_83570d20435b09bd92b053bc6db15839.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_6101a422b6f37af4fce52dc2a335e1a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_6101a422b6f37af4fce52dc2a335e1a1.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_67ff0d6a3d08179d9f6b2c379dcec400.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_67ff0d6a3d08179d9f6b2c379dcec400.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_b5a0d2e40ca4d4dedf9328b1a8ed35e0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b5a0d2e40ca4d4dedf9328b1a8ed35e0.jpg already downloaded
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F80%252F948076ac39b19b68fd128082baace6af%252Fpa%252FDS45210_90e147cee6656f8eb23222dee52720ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_90e147cee6656f8eb23222dee52720ad.jpg already downloaded
2026-01-28 17:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aec6147c-8aca-5d20-818f-f53f75f806c8, identifier: DS45210
2026-01-28 17:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 083bfa2f-8d75-5801-a30d-2104b136f327 with identifier: CC06310
2026-01-28 17:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 083bfa2f-8d75-5801-a30d-2104b136f327 with scrape type 1
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg not downloaded yet
2026-01-28 17:03:49 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bef2c2b-665c-50a0-980f-9cbb30315781 with identifier: DM54288
2026-01-28 17:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bef2c2b-665c-50a0-980f-9cbb30315781 with scrape type 2
2026-01-28 17:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bef2c2b-665c-50a0-980f-9cbb30315781 with scrape type 2
2026-01-28 17:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9bef2c2b-665c-50a0-980f-9cbb30315781, identifier: DM54288
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg not downloaded yet
2026-01-28 17:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b with identifier: TL86494
2026-01-28 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b with identifier: TL86494
2026-01-28 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143573 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143573
2026-01-28 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b spider: auto1.es
2026-01-28 17:03:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 47b5e722-3bdb-5c40-aed1-59c0d4aeb89b due to rule: high_mileage_for_make.json, error: 143573 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143573
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:01:25Z',
 'fuel_type': 'diesel',
 'id': '47b5e722-3bdb-5c40-aed1-59c0d4aeb89b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL86494',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 143573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL86494%27 HTTP/1.1" 200 None
2026-01-28 17:03:50 [auto1.es] INFO: Saving data for TL86494: {'auction_closing_time': 1769702485.0, 'created_time': 1768218179.232632, 'last_price_update_time': 1769619830.277186}
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TL86494') HTTP/1.1" 204 0
2026-01-28 17:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ef43cbb0-45d2-53e5-bdbc-4528bc365e5c with identifier: KD77535
2026-01-28 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ef43cbb0-45d2-53e5-bdbc-4528bc365e5c with identifier: KD77535
2026-01-28 17:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ef43cbb0-45d2-53e5-bdbc-4528bc365e5c with identifier: KD77535 to the API
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD77535>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:08:58Z',
 'fuel_type': 'petrol',
 'id': 'ef43cbb0-45d2-53e5-bdbc-4528bc365e5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD77535',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 77481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_6e6e63890be8f359afb91acc102c7730.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_d92e9f7589eb3079d6a5e5bd964981ea.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5663aaa46fa9d1f72191bbce9014d69d.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5334ade11e6b733e5e206cd42c3c4cd6.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_dc054f055c742f3226bdf4486bddc155.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_212bd9d9909bbf0edec99130289616a0.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bca6cbdbf1e122f3efbae21a18d5faf1.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1af14e08d027245c1f572f3b0bba9ebf.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_353171ef71373c1da9386107fc46e336.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_56a526d7f0b7ab6cc82f93da0abdc31d.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_f2a6d461dd43124750fbdde2e1d01521.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5a2778ac22259d44aa949609528a26ef.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_b0c0b671c0861b18418d95356e692329.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bce604e2721522fa397302fe326b2324.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1994c127deaa3435dd895efda61e8008.jpg',
                'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_e2d9a29d8e6ebfeafc3d5c2056996815.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_6e6e63890be8f359afb91acc102c7730.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_d92e9f7589eb3079d6a5e5bd964981ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5663aaa46fa9d1f72191bbce9014d69d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5334ade11e6b733e5e206cd42c3c4cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_dc054f055c742f3226bdf4486bddc155.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_212bd9d9909bbf0edec99130289616a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bca6cbdbf1e122f3efbae21a18d5faf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1af14e08d027245c1f572f3b0bba9ebf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_353171ef71373c1da9386107fc46e336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_56a526d7f0b7ab6cc82f93da0abdc31d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_f2a6d461dd43124750fbdde2e1d01521.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_5a2778ac22259d44aa949609528a26ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45421,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_b0c0b671c0861b18418d95356e692329.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_bce604e2721522fa397302fe326b2324.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_1994c127deaa3435dd895efda61e8008.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef43cbb0-45d2-53e5-bdbc-4528bc365e5c/ef43cbb0-45d2-53e5-bdbc-4528bc365e5c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/80/b8809c0e32c3a424fb2255d94f2d08fd/pa/KD77535_e2d9a29d8e6ebfeafc3d5c2056996815.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Mild-Hybrid R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KD77535%27 HTTP/1.1" 200 None
2026-01-28 17:03:50 [auto1.es] INFO: Saving data for KD77535: {'created_time': 1769619830.612561, 'last_price_update_time': 1769619830.612571, 'auction_closing_time': 1769702938.0}
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KD77535') HTTP/1.1" 204 0
2026-01-28 17:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4252738a-07a5-59df-ab34-c9f6f8b2155b with identifier: ZD56270
2026-01-28 17:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4252738a-07a5-59df-ab34-c9f6f8b2155b with identifier: ZD56270
2026-01-28 17:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4252738a-07a5-59df-ab34-c9f6f8b2155b with identifier: ZD56270 to the API
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD56270>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:33:26Z',
 'fuel_type': 'gas',
 'id': '4252738a-07a5-59df-ab34-c9f6f8b2155b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD56270',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 19961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2023}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD56270%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [auto1.es] INFO: Saving data for ZD56270: {'auction_closing_time': 1769704406.0, 'created_time': 1767365141.593666, 'last_price_update_time': 1769619831.065804}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD56270') HTTP/1.1" 204 0
2026-01-28 17:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aec6147c-8aca-5d20-818f-f53f75f806c8 with identifier: DS45210
2026-01-28 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aec6147c-8aca-5d20-818f-f53f75f806c8 with identifier: DS45210
2026-01-28 17:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aec6147c-8aca-5d20-818f-f53f75f806c8 with identifier: DS45210 to the API
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS45210>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 231,
 'expiration_date': '2026-01-29T16:39:53Z',
 'fuel_type': 'diesel',
 'id': 'aec6147c-8aca-5d20-818f-f53f75f806c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS45210',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 109511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_f2ab544ce51cb4894c723c26f9ee7d11.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0d5b0dbc9d7237e523255a930b168ea5.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0366a40d7c84128638866576d725c245.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0cb06e2dbc79a4667897a7356fa3e890.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_ca367fe7b67ad8b10c005ac035ff580d.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_4a25479901c05b54cf35a67bf8be0b7b.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_681c95c58a703bf81b280b52e502689a.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_9a1845474e047f144a44399a9615d4e2.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_d77e37e59c4233429c9366e7237c60c3.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b226cd0dbb97971c670aff59a9d9f5b4.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_3357622bdd18b20277f40c966bcc3192.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_83570d20435b09bd92b053bc6db15839.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_6101a422b6f37af4fce52dc2a335e1a1.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_67ff0d6a3d08179d9f6b2c379dcec400.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b5a0d2e40ca4d4dedf9328b1a8ed35e0.jpg',
                'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_90e147cee6656f8eb23222dee52720ad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_f2ab544ce51cb4894c723c26f9ee7d11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0d5b0dbc9d7237e523255a930b168ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0366a40d7c84128638866576d725c245.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_0cb06e2dbc79a4667897a7356fa3e890.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_ca367fe7b67ad8b10c005ac035ff580d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_4a25479901c05b54cf35a67bf8be0b7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_681c95c58a703bf81b280b52e502689a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_9a1845474e047f144a44399a9615d4e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_d77e37e59c4233429c9366e7237c60c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b226cd0dbb97971c670aff59a9d9f5b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_3357622bdd18b20277f40c966bcc3192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_83570d20435b09bd92b053bc6db15839.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_6101a422b6f37af4fce52dc2a335e1a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_67ff0d6a3d08179d9f6b2c379dcec400.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_b5a0d2e40ca4d4dedf9328b1a8ed35e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aec6147c-8aca-5d20-818f-f53f75f806c8/aec6147c-8aca-5d20-818f-f53f75f806c8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/80/948076ac39b19b68fd128082baace6af/pa/DS45210_90e147cee6656f8eb23222dee52720ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X4 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS45210%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [auto1.es] INFO: Saving data for DS45210: {'created_time': 1769619831.399205, 'last_price_update_time': 1769619831.399215, 'auction_closing_time': 1769704793.0}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS45210') HTTP/1.1" 204 0
2026-01-28 17:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9bef2c2b-665c-50a0-980f-9cbb30315781 with identifier: DM54288
2026-01-28 17:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9bef2c2b-665c-50a0-980f-9cbb30315781 with identifier: DM54288
2026-01-28 17:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9bef2c2b-665c-50a0-980f-9cbb30315781 with identifier: DM54288 to the API
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM54288>
{'auction_title': '',
 'c_o_2_emission_value': 26,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:01:11Z',
 'fuel_type': 'hybrid',
 'id': '9bef2c2b-665c-50a0-980f-9cbb30315781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM54288',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 35407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM54288%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [auto1.es] INFO: Saving data for DM54288: {'auction_closing_time': 1769702471.0, 'created_time': 1767872431.900144, 'last_price_update_time': 1769619831.766454}
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM54288') HTTP/1.1" 204 0
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_a54ed683be6202c77132f4fce6af878c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_9c7848d145a4c34553c662df4acef9e9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_671dc73afca671203ae4712078c836fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_671dc73afca671203ae4712078c836fa.jpg not downloaded yet
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_3ad56101495944965bf53ea7f27e6d36.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3ad56101495944965bf53ea7f27e6d36.jpg not downloaded yet
2026-01-28 17:03:51 [auto1.es] INFO: Found listing with ID: KH43607
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [auto1.es] INFO: Scrape type for KH43607: 2
2026-01-28 17:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_719ba8863d3bae6864fc5cb75b66adde.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_719ba8863d3bae6864fc5cb75b66adde.jpg not downloaded yet
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK49893> (referer: https://www.auto1.com/v1/car-details-view/YK49893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a07a2b927445cdb7f41be7da8573023d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_08b7fc714c05db71919b070e781f1a30.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_08b7fc714c05db71919b070e781f1a30.jpg not downloaded yet
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_949c09b0f2b2549f5a71531795e5a046.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_949c09b0f2b2549f5a71531795e5a046.jpg not downloaded yet
2026-01-28 17:03:51 [auto1.es] INFO: Found listing with ID: DJ93903
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ93903%27 HTTP/1.1" 200 None
2026-01-28 17:03:51 [auto1.es] INFO: Scrape type for DJ93903: 1
2026-01-28 17:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6364e050>
2026-01-28 17:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_f36347bcd96568785ce47320202a8b66.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f36347bcd96568785ce47320202a8b66.jpg saved to cache
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f7590>
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_8bddce08a5726663eeb2a2231ef756f3.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8bddce08a5726663eeb2a2231ef756f3.jpg saved to cache
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6271a990>
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg saved to cache
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg not downloaded yet
2026-01-28 17:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_96c34b1daf1571abd6dacfed36569327.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_f07f9f555120f044268ae99db8eaf590.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_f07f9f555120f044268ae99db8eaf590.jpg not downloaded yet
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_935229314c67ea3c0a589c2d58da3c1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_935229314c67ea3c0a589c2d58da3c1d.jpg not downloaded yet
2026-01-28 17:03:52 [auto1.es] INFO: Found listing with ID: AX39994
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX39994%27 HTTP/1.1" 200 None
2026-01-28 17:03:52 [auto1.es] INFO: Scrape type for AX39994: 2
2026-01-28 17:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_688afcfb8f205103052376e91b84ce1a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_759957d3523d9a44b7934aa434892326.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_759957d3523d9a44b7934aa434892326.jpg not downloaded yet
2026-01-28 17:03:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627db9d0>
2026-01-28 17:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg saved to cache
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6276d750>
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_a54ed683be6202c77132f4fce6af878c.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_a54ed683be6202c77132f4fce6af878c.jpg saved to cache
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62785710>
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_9c7848d145a4c34553c662df4acef9e9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_9c7848d145a4c34553c662df4acef9e9.jpg saved to cache
2026-01-28 17:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6273e6d0>
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg saved to cache
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627348d0>
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg saved to cache
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e8e90>
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg saved to cache
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbc99341-966a-591b-abb1-eb2d0498aa24 with identifier: YK49893
2026-01-28 17:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc99341-966a-591b-abb1-eb2d0498aa24 with scrape type 1
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg not downloaded yet
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627cc890>
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_a07a2b927445cdb7f41be7da8573023d.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a07a2b927445cdb7f41be7da8573023d.jpg saved to cache
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg not downloaded yet
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_c4fe3d7e9b800ed37530cd34db089880.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_c4fe3d7e9b800ed37530cd34db089880.jpg not downloaded yet
2026-01-28 17:03:54 [auto1.es] INFO: Found listing with ID: PW29184
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW29184%27 HTTP/1.1" 200 None
2026-01-28 17:03:54 [auto1.es] INFO: Scrape type for PW29184: 2
2026-01-28 17:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_195559ad7925ad08080796fafce5c363.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_195559ad7925ad08080796fafce5c363.jpg not downloaded yet
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_2945c5aca50e4fe35208aec652785168.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_2945c5aca50e4fe35208aec652785168.jpg not downloaded yet
2026-01-28 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC86187/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62733910>
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg saved to cache
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a61090>
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_96c34b1daf1571abd6dacfed36569327.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_96c34b1daf1571abd6dacfed36569327.jpg saved to cache
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cffd915d00388d0300e2bc1b126f5968.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_09251f497784d130857fb5b4e2434908.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_09251f497784d130857fb5b4e2434908.jpg not downloaded yet
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg not downloaded yet
2026-01-28 17:03:55 [auto1.es] INFO: Found listing with ID: ZE32903
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE32903%27 HTTP/1.1" 200 None
2026-01-28 17:03:55 [auto1.es] INFO: Scrape type for ZE32903: 2
2026-01-28 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK77836> (referer: https://www.auto1.com/v1/car-details-view/RK77836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW09028> (referer: https://www.auto1.com/v1/car-details-view/SW09028/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF01529> (referer: https://www.auto1.com/v1/car-details-view/VF01529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341b9d0>
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg saved to cache
2026-01-28 17:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634efcd0>
2026-01-28 17:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_688afcfb8f205103052376e91b84ce1a.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_688afcfb8f205103052376e91b84ce1a.jpg saved to cache
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63408110>
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff0%252Fc0f0ad6faaeabbdd1b3469c511937faa%252Fpa%252FRP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg saved to cache
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35
2026-01-28 17:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35, skipping ID generation
2026-01-28 17:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 with scrape type 1
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 from tracking dictionaries
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 sending to next pipeline
2026-01-28 17:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35, identifier: RP64804
2026-01-28 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_08b7fc714c05db71919b070e781f1a30.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3ad56101495944965bf53ea7f27e6d36.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_a561a4c856382b47860d97748b52dcc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_a561a4c856382b47860d97748b52dcc0.jpg not downloaded yet
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg not downloaded yet
2026-01-28 17:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 with identifier: RP64804
2026-01-28 17:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 with identifier: RP64804
2026-01-28 17:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177247 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177247
2026-01-28 17:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 spider: auto1.es
2026-01-28 17:03:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a18ea57e-8a07-5001-bbe8-64dc9eeb5b35 due to rule: high_mileage_for_country.json, error: 177247 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177247
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:32:45Z',
 'fuel_type': 'diesel',
 'id': 'a18ea57e-8a07-5001-bbe8-64dc9eeb5b35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP64804',
 'listing': 'auction',
 'location': 'ES, Tudela',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 177247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b94f7902c5f066516dd7e5f3e71667e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3b8194eb545ba0bb42a2f93cd89c57de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_8b08138f9e9a0a29e117ac90d1479124.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_edf3d4857b91d6288d6f6f93515a8447.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_047f29be27bb09ee7e59618e6a5bc8ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_cd83656e40f66a9aa5b75808c6e80f14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_38b4029fa6f86273a6180f09778b4722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_2d2ef6239553b10b2a110a853e16fea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3946a1490e11eb1483af42761d8954e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b62f2fd7b109ff4365871b1ce37302bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_ae4ed12c85e19758281fc47aaac57ae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_84d3f4f2b17acb05385ff1b1f17574c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_9e79a687e5d95c9c7ebe93757e537649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_3eda720472a39f8cf208aabca9ef6f80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_f6da53854b390984670145b9a8d1643e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18ea57e-8a07-5001-bbe8-64dc9eeb5b35/a18ea57e-8a07-5001-bbe8-64dc9eeb5b35_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f0/c0f0ad6faaeabbdd1b3469c511937faa/pa/RP64804_b78904b44c793d7bdeda41cfd765bdb4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP64804%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [auto1.es] INFO: Saving data for RP64804: {'created_time': 1769619837.026345, 'last_price_update_time': 1769619837.026355, 'auction_closing_time': 1769704365.0}
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RP64804') HTTP/1.1" 204 0
2026-01-28 17:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_949c09b0f2b2549f5a71531795e5a046.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_719ba8863d3bae6864fc5cb75b66adde.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_ba948b7b36711c1a442ad26c687db4bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_ba948b7b36711c1a442ad26c687db4bd.jpg not downloaded yet
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg not downloaded yet
2026-01-28 17:03:57 [auto1.es] INFO: Found listing with ID: HS89445
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS89445%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [auto1.es] INFO: Scrape type for HS89445: 2
2026-01-28 17:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260c910>
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg saved to cache
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg not downloaded yet
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg not downloaded yet
2026-01-28 17:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN49784> (referer: https://www.auto1.com/v1/car-details-view/CN49784/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f3b50>
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cffd915d00388d0300e2bc1b126f5968.jpg') HTTP/1.1" 204 0
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cffd915d00388d0300e2bc1b126f5968.jpg saved to cache
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9178d754-4f46-557d-8878-0ca2edf0f736 with identifier: RK77836
2026-01-28 17:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9178d754-4f46-557d-8878-0ca2edf0f736 with scrape type 2
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9178d754-4f46-557d-8878-0ca2edf0f736 with scrape type 2
2026-01-28 17:03:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9178d754-4f46-557d-8878-0ca2edf0f736, identifier: RK77836
2026-01-28 17:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d98da5e-c681-566b-b11f-19dd27e8d4f4 with identifier: SW09028
2026-01-28 17:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d98da5e-c681-566b-b11f-19dd27e8d4f4 with scrape type 1
2026-01-28 17:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 14 photos for item 5d98da5e-c681-566b-b11f-19dd27e8d4f4
2026-01-28 17:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_4162ce3d4cc9ae3941397449246f1fc6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_4162ce3d4cc9ae3941397449246f1fc6.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_54103d6d307481529bca8b018d9b8c63.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_54103d6d307481529bca8b018d9b8c63.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_ab7664456960e58f5cf0ee30a0dca5d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_ab7664456960e58f5cf0ee30a0dca5d1.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_80cd9e10eb34fd0237f7fe5ecac7e24b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_80cd9e10eb34fd0237f7fe5ecac7e24b.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_e66117a840f8a769de9ffe14beec7274.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_e66117a840f8a769de9ffe14beec7274.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_13a922c1e543730846160d8c8c1e8a87.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_13a922c1e543730846160d8c8c1e8a87.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_76d78a62b89b2e920514fb487d001d17.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_76d78a62b89b2e920514fb487d001d17.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_05d329b4ab311d658ef054f5c9980e1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_05d329b4ab311d658ef054f5c9980e1c.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_bff4f532e067116a420e30128d093d64.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_bff4f532e067116a420e30128d093d64.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_2c8ab2b477796208ba75b3fc1d5e4930.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_2c8ab2b477796208ba75b3fc1d5e4930.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_7f6ba8881d71c3aababc2f6d76dcb2e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_7f6ba8881d71c3aababc2f6d76dcb2e8.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_a333992025175e7b1daa4ccdbe2b2705.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_a333992025175e7b1daa4ccdbe2b2705.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_fb96cd92119bcb462dffb41b4f1d6a85.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_fb96cd92119bcb462dffb41b4f1d6a85.jpg already downloaded
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F28%252Fd228115b921b6255ccc2e9efffd3e1de%252Fpa%252FSW09028_29abb1fbe9a03585b163cf9785e5d017.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_29abb1fbe9a03585b163cf9785e5d017.jpg already downloaded
2026-01-28 17:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d98da5e-c681-566b-b11f-19dd27e8d4f4, identifier: SW09028
2026-01-28 17:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6cc6506-81e8-5029-af4d-9f81e9139c26 with identifier: VF01529
2026-01-28 17:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cc6506-81e8-5029-af4d-9f81e9139c26 with scrape type 2
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6cc6506-81e8-5029-af4d-9f81e9139c26 with scrape type 2
2026-01-28 17:03:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6cc6506-81e8-5029-af4d-9f81e9139c26, identifier: VF01529
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg not downloaded yet
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_22d85ba85153259c89ae02a12744a865.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_22d85ba85153259c89ae02a12744a865.jpg not downloaded yet
2026-01-28 17:03:58 [auto1.es] INFO: Found listing with ID: MH75346
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH75346%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [auto1.es] INFO: Scrape type for MH75346: 1
2026-01-28 17:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9178d754-4f46-557d-8878-0ca2edf0f736 with identifier: RK77836
2026-01-28 17:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9178d754-4f46-557d-8878-0ca2edf0f736 with identifier: RK77836
2026-01-28 17:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9178d754-4f46-557d-8878-0ca2edf0f736 with identifier: RK77836 to the API
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RK77836>
{'auction_title': '',
 'c_o_2_emission_value': 10,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 272,
 'expiration_date': '2026-01-29T16:16:41Z',
 'fuel_type': 'hybrid',
 'id': '9178d754-4f46-557d-8878-0ca2edf0f736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK77836',
 'listing': 'auction',
 'location': 'ES, Colloto, Oviedo',
 'make': 'Cupra',
 'model': 'Terramar',
 'odometer': 1122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Terramar 1.5 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2025}
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK77836%27 HTTP/1.1" 200 None
2026-01-28 17:03:58 [auto1.es] INFO: Saving data for RK77836: {'auction_closing_time': 1769703401.0, 'created_time': 1768217891.390061, 'last_price_update_time': 1769619838.829802}
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK77836') HTTP/1.1" 204 0
2026-01-28 17:03:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d98da5e-c681-566b-b11f-19dd27e8d4f4 with identifier: SW09028
2026-01-28 17:03:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d98da5e-c681-566b-b11f-19dd27e8d4f4 with identifier: SW09028
2026-01-28 17:03:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d98da5e-c681-566b-b11f-19dd27e8d4f4 with identifier: SW09028 to the API
2026-01-28 17:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SW09028>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:50:22Z',
 'fuel_type': 'diesel',
 'id': '5d98da5e-c681-566b-b11f-19dd27e8d4f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW09028',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 41768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_4162ce3d4cc9ae3941397449246f1fc6.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_54103d6d307481529bca8b018d9b8c63.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_ab7664456960e58f5cf0ee30a0dca5d1.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_80cd9e10eb34fd0237f7fe5ecac7e24b.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_e66117a840f8a769de9ffe14beec7274.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_13a922c1e543730846160d8c8c1e8a87.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_76d78a62b89b2e920514fb487d001d17.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_05d329b4ab311d658ef054f5c9980e1c.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_bff4f532e067116a420e30128d093d64.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_2c8ab2b477796208ba75b3fc1d5e4930.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_7f6ba8881d71c3aababc2f6d76dcb2e8.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_a333992025175e7b1daa4ccdbe2b2705.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_fb96cd92119bcb462dffb41b4f1d6a85.jpg',
                'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_29abb1fbe9a03585b163cf9785e5d017.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_4162ce3d4cc9ae3941397449246f1fc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_54103d6d307481529bca8b018d9b8c63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_ab7664456960e58f5cf0ee30a0dca5d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_80cd9e10eb34fd0237f7fe5ecac7e24b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_e66117a840f8a769de9ffe14beec7274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_13a922c1e543730846160d8c8c1e8a87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_76d78a62b89b2e920514fb487d001d17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_05d329b4ab311d658ef054f5c9980e1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_bff4f532e067116a420e30128d093d64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_2c8ab2b477796208ba75b3fc1d5e4930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_7f6ba8881d71c3aababc2f6d76dcb2e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_a333992025175e7b1daa4ccdbe2b2705.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_fb96cd92119bcb462dffb41b4f1d6a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d98da5e-c681-566b-b11f-19dd27e8d4f4/5d98da5e-c681-566b-b11f-19dd27e8d4f4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/28/d228115b921b6255ccc2e9efffd3e1de/pa/SW09028_29abb1fbe9a03585b163cf9785e5d017.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW09028%27 HTTP/1.1" 200 None
2026-01-28 17:03:59 [auto1.es] INFO: Saving data for SW09028: {'created_time': 1769619839.459566, 'last_price_update_time': 1769619839.459578, 'auction_closing_time': 1769705422.0}
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW09028') HTTP/1.1" 204 0
2026-01-28 17:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6cc6506-81e8-5029-af4d-9f81e9139c26 with identifier: VF01529
2026-01-28 17:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6cc6506-81e8-5029-af4d-9f81e9139c26 with identifier: VF01529
2026-01-28 17:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b6cc6506-81e8-5029-af4d-9f81e9139c26 with identifier: VF01529 to the API
2026-01-28 17:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VF01529>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:10:33Z',
 'fuel_type': 'diesel',
 'id': 'b6cc6506-81e8-5029-af4d-9f81e9139c26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF01529',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 67319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper D',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VF01529%27 HTTP/1.1" 200 None
2026-01-28 17:04:00 [auto1.es] INFO: Saving data for VF01529: {'auction_closing_time': 1769703033.0, 'created_time': 1768474289.218691, 'last_price_update_time': 1769619840.695219}
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VF01529') HTTP/1.1" 204 0
2026-01-28 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_2945c5aca50e4fe35208aec652785168.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_c4fe3d7e9b800ed37530cd34db089880.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg not downloaded yet
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg not downloaded yet
2026-01-28 17:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ93903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6265c690>
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_08b7fc714c05db71919b070e781f1a30.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_08b7fc714c05db71919b070e781f1a30.jpg saved to cache
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272a690>
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_3ad56101495944965bf53ea7f27e6d36.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3ad56101495944965bf53ea7f27e6d36.jpg saved to cache
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62960450>
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_949c09b0f2b2549f5a71531795e5a046.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_949c09b0f2b2549f5a71531795e5a046.jpg saved to cache
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63476f90>
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_719ba8863d3bae6864fc5cb75b66adde.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_719ba8863d3bae6864fc5cb75b66adde.jpg saved to cache
2026-01-28 17:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63377350>
2026-01-28 17:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg saved to cache
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_09251f497784d130857fb5b4e2434908.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_759957d3523d9a44b7934aa434892326.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_195559ad7925ad08080796fafce5c363.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_32df5ea16203866ed04759abc33b73cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_32df5ea16203866ed04759abc33b73cb.jpg not downloaded yet
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_ec40a4de42bc346a8998ada083e7768d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_ec40a4de42bc346a8998ada083e7768d.jpg not downloaded yet
2026-01-28 17:04:02 [auto1.es] INFO: Found listing with ID: MJ22507
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [auto1.es] INFO: Scrape type for MJ22507: 2
2026-01-28 17:04:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_886471bae1326732e724b44d1bf2e547.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_886471bae1326732e724b44d1bf2e547.jpg not downloaded yet
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_64c520c51c42af4d9162e399a6e46af0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_64c520c51c42af4d9162e399a6e46af0.jpg not downloaded yet
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63503090>
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg saved to cache
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2026-01-28 17:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3990a2cb-8881-5446-b576-3be4d54fac77 with scrape type 2
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3990a2cb-8881-5446-b576-3be4d54fac77 with scrape type 2
2026-01-28 17:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3990a2cb-8881-5446-b576-3be4d54fac77, identifier: CN49784
2026-01-28 17:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_1be491699988007bbc2c244fdf3f4b75.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_1be491699988007bbc2c244fdf3f4b75.jpg not downloaded yet
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg not downloaded yet
2026-01-28 17:04:02 [auto1.es] INFO: Found listing with ID: TS34361
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS34361%27 HTTP/1.1" 200 None
2026-01-28 17:04:02 [auto1.es] INFO: Scrape type for TS34361: 2
2026-01-28 17:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2026-01-28 17:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784
2026-01-28 17:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3990a2cb-8881-5446-b576-3be4d54fac77 with identifier: CN49784 to the API
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CN49784>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 245,
 'expiration_date': '2026-01-29T16:50:19Z',
 'fuel_type': 'hybrid',
 'id': '3990a2cb-8881-5446-b576-3be4d54fac77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN49784',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 63411,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN49784%27 HTTP/1.1" 200 None
2026-01-28 17:04:03 [auto1.es] INFO: Saving data for CN49784: {'auction_closing_time': 1769705419.0, 'created_time': 1768565196.572407, 'last_price_update_time': 1769619843.058303}
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN49784') HTTP/1.1" 204 0
2026-01-28 17:04:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633c2650>
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg saved to cache
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aede90>
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_2945c5aca50e4fe35208aec652785168.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_2945c5aca50e4fe35208aec652785168.jpg saved to cache
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6332e250>
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_c4fe3d7e9b800ed37530cd34db089880.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_c4fe3d7e9b800ed37530cd34db089880.jpg saved to cache
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg not downloaded yet
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_4a4c89ffaad145c1fd523242fe49d785.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_4a4c89ffaad145c1fd523242fe49d785.jpg not downloaded yet
2026-01-28 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg not downloaded yet
2026-01-28 17:04:03 [auto1.es] INFO: Found listing with ID: NA02038
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA02038%27 HTTP/1.1" 200 None
2026-01-28 17:04:03 [auto1.es] INFO: Scrape type for NA02038: 2
2026-01-28 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AX39994/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE32903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a3c450>
2026-01-28 17:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_09251f497784d130857fb5b4e2434908.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_09251f497784d130857fb5b4e2434908.jpg saved to cache
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62776890>
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_759957d3523d9a44b7934aa434892326.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_759957d3523d9a44b7934aa434892326.jpg saved to cache
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627bdf10>
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_195559ad7925ad08080796fafce5c363.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_195559ad7925ad08080796fafce5c363.jpg saved to cache
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627bf190>
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg saved to cache
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:04 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_22d85ba85153259c89ae02a12744a865.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:04 [scrapy.extensions.logstats] INFO: Crawled 543 pages (at 99 pages/min), scraped 152 items (at 25 items/min)
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_0b13097c7d0697ee25d98464086180ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_0b13097c7d0697ee25d98464086180ea.jpg not downloaded yet
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_452694df09b653f8c04961f385e2957c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_452694df09b653f8c04961f385e2957c.jpg not downloaded yet
2026-01-28 17:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH43607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW29184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62784f10>
2026-01-28 17:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg saved to cache
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg not downloaded yet
2026-01-28 17:04:05 [auto1.es] INFO: Found listing with ID: HL07550
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL07550%27 HTTP/1.1" 200 None
2026-01-28 17:04:05 [auto1.es] INFO: Scrape type for HL07550: 1
2026-01-28 17:04:05 [auto1.es] INFO: Found listing with ID: DY06551
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY06551%27 HTTP/1.1" 200 None
2026-01-28 17:04:05 [auto1.es] INFO: Scrape type for DY06551: 2
2026-01-28 17:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_64c520c51c42af4d9162e399a6e46af0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_886471bae1326732e724b44d1bf2e547.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_ec40a4de42bc346a8998ada083e7768d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg not downloaded yet
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6270b0d0>
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg saved to cache
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62693810>
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg saved to cache
2026-01-28 17:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63419b90>
2026-01-28 17:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg saved to cache
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg not downloaded yet
2026-01-28 17:04:06 [auto1.es] INFO: Found listing with ID: GR78832
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78832%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [auto1.es] INFO: Scrape type for GR78832: 2
2026-01-28 17:04:06 [auto1.es] INFO: Found listing with ID: SB20640
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB20640%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [auto1.es] INFO: Scrape type for SB20640: 2
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63645dd0>
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg saved to cache
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633cf850>
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_22d85ba85153259c89ae02a12744a865.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_22d85ba85153259c89ae02a12744a865.jpg saved to cache
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_4a4c89ffaad145c1fd523242fe49d785.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_3834d9210a8dbc402e01da27e272bb53.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3834d9210a8dbc402e01da27e272bb53.jpg not downloaded yet
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS89445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_2ed463c70da50efc1389969c464013eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2ed463c70da50efc1389969c464013eb.jpg not downloaded yet
2026-01-28 17:04:06 [auto1.es] INFO: Found listing with ID: PA70803
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA70803%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [auto1.es] INFO: Scrape type for PA70803: 2
2026-01-28 17:04:06 [auto1.es] INFO: Found listing with ID: RT43870
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT43870%27 HTTP/1.1" 200 None
2026-01-28 17:04:06 [auto1.es] INFO: Scrape type for RT43870: 2
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MH75346/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC86187> (referer: https://www.auto1.com/v1/car-details-view/ZC86187/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63474710>
2026-01-28 17:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg saved to cache
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e4450>
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_64c520c51c42af4d9162e399a6e46af0.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_64c520c51c42af4d9162e399a6e46af0.jpg saved to cache
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291b3d0>
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_886471bae1326732e724b44d1bf2e547.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_886471bae1326732e724b44d1bf2e547.jpg saved to cache
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628d5990>
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_ec40a4de42bc346a8998ada083e7768d.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_ec40a4de42bc346a8998ada083e7768d.jpg saved to cache
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_d714593a539b5d961d17aa44b9f9429c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_d714593a539b5d961d17aa44b9f9429c.jpg not downloaded yet
2026-01-28 17:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg not downloaded yet
2026-01-28 17:04:07 [auto1.es] INFO: Found listing with ID: ZA44200
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA44200%27 HTTP/1.1" 200 None
2026-01-28 17:04:07 [auto1.es] INFO: Scrape type for ZA44200: 2
2026-01-28 17:04:07 [auto1.es] INFO: Found listing with ID: TP24592
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP24592%27 HTTP/1.1" 200 None
2026-01-28 17:04:07 [auto1.es] INFO: Scrape type for TP24592: 2
2026-01-28 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_1be491699988007bbc2c244fdf3f4b75.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_0b13097c7d0697ee25d98464086180ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_452694df09b653f8c04961f385e2957c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg not downloaded yet
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a0cd0>
2026-01-28 17:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_4a4c89ffaad145c1fd523242fe49d785.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_4a4c89ffaad145c1fd523242fe49d785.jpg saved to cache
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627bea50>
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg saved to cache
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d38d0>
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg saved to cache
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9760e7b-6282-5375-accb-7e4dbd14081d with identifier: ZC86187
2026-01-28 17:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9760e7b-6282-5375-accb-7e4dbd14081d with scrape type 2
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9760e7b-6282-5375-accb-7e4dbd14081d with scrape type 2
2026-01-28 17:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c9760e7b-6282-5375-accb-7e4dbd14081d, identifier: ZC86187
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_9652a3f2b909910a4766002d9bea9d35.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_9652a3f2b909910a4766002d9bea9d35.jpg not downloaded yet
2026-01-28 17:04:08 [auto1.es] INFO: Found listing with ID: WJ58793
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ58793%27 HTTP/1.1" 200 None
2026-01-28 17:04:08 [auto1.es] INFO: Scrape type for WJ58793: 2
2026-01-28 17:04:08 [auto1.es] INFO: Found listing with ID: DN08712
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN08712%27 HTTP/1.1" 200 None
2026-01-28 17:04:08 [auto1.es] INFO: Scrape type for DN08712: 2
2026-01-28 17:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c9760e7b-6282-5375-accb-7e4dbd14081d with identifier: ZC86187
2026-01-28 17:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c9760e7b-6282-5375-accb-7e4dbd14081d with identifier: ZC86187
2026-01-28 17:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c9760e7b-6282-5375-accb-7e4dbd14081d with identifier: ZC86187 to the API
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZC86187>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:08:53Z',
 'fuel_type': 'petrol',
 'id': 'c9760e7b-6282-5375-accb-7e4dbd14081d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC86187',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 86786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Mild-Hybrid GLE',
 'transmission': 'manual',
 'trim': 'GLE',
 'year': 2021}
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZC86187%27 HTTP/1.1" 200 None
2026-01-28 17:04:09 [auto1.es] INFO: Saving data for ZC86187: {'auction_closing_time': 1769702933.0, 'created_time': 1768475612.373941, 'last_price_update_time': 1769619849.571713}
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZC86187') HTTP/1.1" 204 0
2026-01-28 17:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3834d9210a8dbc402e01da27e272bb53.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg not downloaded yet
2026-01-28 17:04:09 [auto1.es] INFO: Found listing with ID: EL81396
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL81396%27 HTTP/1.1" 200 None
2026-01-28 17:04:09 [auto1.es] INFO: Scrape type for EL81396: 2
2026-01-28 17:04:09 [auto1.es] INFO: Found listing with ID: FS52760
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS52760%27 HTTP/1.1" 200 None
2026-01-28 17:04:09 [auto1.es] INFO: Scrape type for FS52760: 2
2026-01-28 17:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA02038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633c2390>
2026-01-28 17:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg saved to cache
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627333d0>
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_1be491699988007bbc2c244fdf3f4b75.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_1be491699988007bbc2c244fdf3f4b75.jpg saved to cache
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62691d90>
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_0b13097c7d0697ee25d98464086180ea.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_0b13097c7d0697ee25d98464086180ea.jpg saved to cache
2026-01-28 17:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282e690>
2026-01-28 17:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_452694df09b653f8c04961f385e2957c.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_452694df09b653f8c04961f385e2957c.jpg saved to cache
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_dda3f2354c2a7e46c99e643223800b72.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_dda3f2354c2a7e46c99e643223800b72.jpg not downloaded yet
2026-01-28 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_d714593a539b5d961d17aa44b9f9429c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: TG55276
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for TG55276: 2
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: RH54458
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH54458%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for RH54458: 2
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg not downloaded yet
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW29184> (referer: https://www.auto1.com/v1/car-details-view/PW29184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ93903> (referer: https://www.auto1.com/v1/car-details-view/DJ93903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ22507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288cd90>
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg saved to cache
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62883690>
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_3834d9210a8dbc402e01da27e272bb53.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3834d9210a8dbc402e01da27e272bb53.jpg saved to cache
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:11 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: ML61701
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML61701%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for ML61701: 2
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: ZG47270
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG47270%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for ZG47270: 2
2026-01-28 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_a8e342195cd0bfe56cf9bba619119db1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_a8e342195cd0bfe56cf9bba619119db1.jpg not downloaded yet
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: AV92592
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV92592%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for AV92592: 2
2026-01-28 17:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_9652a3f2b909910a4766002d9bea9d35.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: FV87750
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV87750%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for FV87750: 2
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: LD09129
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD09129%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for LD09129: 2
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: CN20473
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN20473%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for CN20473: 2
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: AK15257
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK15257%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for AK15257: 1
2026-01-28 17:04:11 [auto1.es] INFO: Found listing with ID: EB78229
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB78229%27 HTTP/1.1" 200 None
2026-01-28 17:04:11 [auto1.es] INFO: Scrape type for EB78229: 2
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633c2d10>
2026-01-28 17:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_d714593a539b5d961d17aa44b9f9429c.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_d714593a539b5d961d17aa44b9f9429c.jpg saved to cache
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19b7468-fc7b-5e9c-bc67-5e5c30748b26 with identifier: PW29184
2026-01-28 17:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19b7468-fc7b-5e9c-bc67-5e5c30748b26 with scrape type 2
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d19b7468-fc7b-5e9c-bc67-5e5c30748b26 with scrape type 2
2026-01-28 17:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d19b7468-fc7b-5e9c-bc67-5e5c30748b26, identifier: PW29184
2026-01-28 17:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e868726-2826-5b65-88f6-a36623628a4b with identifier: DJ93903
2026-01-28 17:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e868726-2826-5b65-88f6-a36623628a4b with scrape type 1
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_19680b55ba863d43286159db79f36fd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_19680b55ba863d43286159db79f36fd1.jpg not downloaded yet
2026-01-28 17:04:12 [auto1.es] INFO: Found listing with ID: XU17252
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU17252%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [auto1.es] INFO: Scrape type for XU17252: 2
2026-01-28 17:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d19b7468-fc7b-5e9c-bc67-5e5c30748b26 with identifier: PW29184
2026-01-28 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d19b7468-fc7b-5e9c-bc67-5e5c30748b26 with identifier: PW29184
2026-01-28 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
2026-01-28 17:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d19b7468-fc7b-5e9c-bc67-5e5c30748b26 spider: auto1.es
2026-01-28 17:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d19b7468-fc7b-5e9c-bc67-5e5c30748b26 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo life' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:33:43Z',
 'fuel_type': 'diesel',
 'id': 'd19b7468-fc7b-5e9c-bc67-5e5c30748b26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW29184',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 173320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2020}
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PW29184%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [auto1.es] INFO: Saving data for PW29184: {'auction_closing_time': 1769704423.0, 'created_time': 1769101306.408151, 'last_price_update_time': 1769619852.482283}
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PW29184') HTTP/1.1" 204 0
2026-01-28 17:04:12 [auto1.es] INFO: Found listing with ID: WA73273
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73273%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [auto1.es] INFO: Scrape type for WA73273: 1
2026-01-28 17:04:12 [auto1.es] INFO: Found listing with ID: RJ66193
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ66193%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [auto1.es] INFO: Scrape type for RJ66193: 2
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_28709748f600c8e95e6a088a7200a999.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_28709748f600c8e95e6a088a7200a999.jpg not downloaded yet
2026-01-28 17:04:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5cc90>
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg saved to cache
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: AG10753
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG10753%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for AG10753: 2
2026-01-28 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS34361/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH43607> (referer: https://www.auto1.com/v1/car-details-view/KH43607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62865dd0>
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg saved to cache
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62864450>
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_9652a3f2b909910a4766002d9bea9d35.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_9652a3f2b909910a4766002d9bea9d35.jpg saved to cache
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: YU72387
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU72387%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for YU72387: 1
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: VP66018
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP66018%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for VP66018: 1
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg not downloaded yet
2026-01-28 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: EM12264
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM12264%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for EM12264: 2
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: KN26353
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN26353%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for KN26353: 1
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: JX65685
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX65685%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for JX65685: 2
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_efba762a4601394a099228aebe03dc30.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_efba762a4601394a099228aebe03dc30.jpg not downloaded yet
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: TS46537
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS46537%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for TS46537: 2
2026-01-28 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB20640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR78832/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: UB28672
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB28672%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for UB28672: 1
2026-01-28 17:04:13 [auto1.es] INFO: Found listing with ID: PT19275
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT19275%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [auto1.es] INFO: Scrape type for PT19275: 2
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_de34e390c630a001622dcf80eb547291.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_de34e390c630a001622dcf80eb547291.jpg not downloaded yet
2026-01-28 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62665cd0>
2026-01-28 17:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg saved to cache
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-01-28 17:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd0a836-1346-559c-ad01-781d4b2a796b with scrape type 2
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd0a836-1346-559c-ad01-781d4b2a796b with scrape type 2
2026-01-28 17:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffd0a836-1346-559c-ad01-781d4b2a796b, identifier: KH43607
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: ZN75442
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN75442%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for ZN75442: 2
2026-01-28 17:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-01-28 17:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffd0a836-1346-559c-ad01-781d4b2a796b with identifier: KH43607
2026-01-28 17:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191608 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191608
2026-01-28 17:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ffd0a836-1346-559c-ad01-781d4b2a796b spider: auto1.es
2026-01-28 17:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ffd0a836-1346-559c-ad01-781d4b2a796b due to rule: high_mileage_for_country.json, error: 191608 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191608
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:32Z',
 'fuel_type': 'diesel',
 'id': 'ffd0a836-1346-559c-ad01-781d4b2a796b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH43607',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 191608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH43607%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Saving data for KH43607: {'auction_closing_time': 1769703392.0, 'created_time': 1769061657.667718, 'last_price_update_time': 1769619854.448669}
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KH43607') HTTP/1.1" 204 0
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: RV91175
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV91175%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for RV91175: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: JK22212
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK22212%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for JK22212: 2
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_834f74eb2547c6aacbc8321954168566.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_834f74eb2547c6aacbc8321954168566.jpg not downloaded yet
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_28709748f600c8e95e6a088a7200a999.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: UG06255
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG06255%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for UG06255: 2
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN08712/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA70803/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RT43870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE32903> (referer: https://www.auto1.com/v1/car-details-view/ZE32903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: BF11696
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF11696%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for BF11696: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: ZD98526
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98526%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for ZD98526: 2
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_fcd44d8e37582751f95fbdece259deea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_fcd44d8e37582751f95fbdece259deea.jpg not downloaded yet
2026-01-28 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: TP19820
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for TP19820: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: TV25666
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV25666%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for TV25666: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: HT82047
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT82047%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for HT82047: 2
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg not downloaded yet
2026-01-28 17:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_efba762a4601394a099228aebe03dc30.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: SY38969
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY38969%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for SY38969: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: TH64101
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH64101%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for TH64101: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: GY84570
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY84570%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for GY84570: 2
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_ea1074d8604925f864a28740676d0f0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_ea1074d8604925f864a28740676d0f0d.jpg not downloaded yet
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: KB87556
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB87556%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for KB87556: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: YJ45268
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ45268%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for YJ45268: 2
2026-01-28 17:04:14 [auto1.es] INFO: Found listing with ID: EY35323
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY35323%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [auto1.es] INFO: Scrape type for EY35323: 2
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg not downloaded yet
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6354aa50>
2026-01-28 17:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_28709748f600c8e95e6a088a7200a999.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_28709748f600c8e95e6a088a7200a999.jpg saved to cache
2026-01-28 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2e89616-9f19-59f9-b94a-4e110fe204e6 with identifier: ZE32903
2026-01-28 17:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2e89616-9f19-59f9-b94a-4e110fe204e6 with scrape type 2
2026-01-28 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2e89616-9f19-59f9-b94a-4e110fe204e6 with scrape type 2
2026-01-28 17:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c2e89616-9f19-59f9-b94a-4e110fe204e6, identifier: ZE32903
2026-01-28 17:04:15 [auto1.es] INFO: Found listing with ID: NK42155
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK42155%27 HTTP/1.1" 200 None
2026-01-28 17:04:15 [auto1.es] INFO: Scrape type for NK42155: 2
2026-01-28 17:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c2e89616-9f19-59f9-b94a-4e110fe204e6 with identifier: ZE32903
2026-01-28 17:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c2e89616-9f19-59f9-b94a-4e110fe204e6 with identifier: ZE32903
2026-01-28 17:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179018 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179018
2026-01-28 17:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c2e89616-9f19-59f9-b94a-4e110fe204e6 spider: auto1.es
2026-01-28 17:04:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c2e89616-9f19-59f9-b94a-4e110fe204e6 due to rule: high_mileage_for_country.json, error: 179018 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179018
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:14:30Z',
 'fuel_type': 'diesel',
 'id': 'c2e89616-9f19-59f9-b94a-4e110fe204e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE32903',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '1er',
 'odometer': 179018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZE32903%27 HTTP/1.1" 200 None
2026-01-28 17:04:15 [auto1.es] INFO: Saving data for ZE32903: {'auction_closing_time': 1769703270.0, 'created_time': 1769101284.248917, 'last_price_update_time': 1769619855.605993}
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZE32903') HTTP/1.1" 204 0
2026-01-28 17:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_834f74eb2547c6aacbc8321954168566.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:15 [auto1.es] INFO: Found listing with ID: YF56333
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF56333%27 HTTP/1.1" 200 None
2026-01-28 17:04:15 [auto1.es] INFO: Scrape type for YF56333: 2
2026-01-28 17:04:15 [auto1.es] INFO: Found listing with ID: PN18739
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN18739%27 HTTP/1.1" 200 None
2026-01-28 17:04:15 [auto1.es] INFO: Scrape type for PN18739: 2
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg not downloaded yet
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627bd510>
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_efba762a4601394a099228aebe03dc30.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_efba762a4601394a099228aebe03dc30.jpg saved to cache
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: HB59232
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB59232%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for HB59232: 2
2026-01-28 17:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ58793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FS52760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: PR87583
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87583%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for PR87583: 1
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: CV01854
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for CV01854: 2
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg not downloaded yet
2026-01-28 17:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: EV50071
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV50071%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for EV50071: 2
2026-01-28 17:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA02038> (referer: https://www.auto1.com/v1/car-details-view/NA02038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e3f90>
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_834f74eb2547c6aacbc8321954168566.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_834f74eb2547c6aacbc8321954168566.jpg saved to cache
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: AV01801
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV01801%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for AV01801: 2
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: XM12351
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM12351%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for XM12351: 2
2026-01-28 17:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: CX51290
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX51290%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for CX51290: 2
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: WE01267
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE01267%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for WE01267: 2
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: EF63413
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF63413%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for EF63413: 2
2026-01-28 17:04:16 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with identifier: NA02038
2026-01-28 17:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with scrape type 2
2026-01-28 17:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with scrape type 2
2026-01-28 17:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7, identifier: NA02038
2026-01-28 17:04:16 [auto1.es] INFO: Found listing with ID: YL08796
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL08796%27 HTTP/1.1" 200 None
2026-01-28 17:04:16 [auto1.es] INFO: Scrape type for YL08796: 2
2026-01-28 17:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with identifier: NA02038
2026-01-28 17:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with identifier: NA02038
2026-01-28 17:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0ba0f3c6-bd59-5aed-89f4-75f0e02191a7 with identifier: NA02038 to the API
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA02038>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:04:58Z',
 'fuel_type': 'diesel',
 'id': '0ba0f3c6-bd59-5aed-89f4-75f0e02191a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA02038',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 57346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Active Pack',
 'transmission': 'manual',
 'trim': 'Active Pack',
 'year': 2022}
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA02038%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Saving data for NA02038: {'auction_closing_time': 1769702698.0, 'created_time': 1768298561.93976, 'last_price_update_time': 1769619857.061101}
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA02038') HTTP/1.1" 204 0
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: WC61871
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC61871%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for WC61871: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: KP16326
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP16326%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for KP16326: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: VM39099
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM39099%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for VM39099: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: AT25707
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT25707%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for AT25707: 2
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RH54458/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: VT87385
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT87385%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for VT87385: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: CU45219
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU45219%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for CU45219: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: CV77036
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV77036%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for CV77036: 2
2026-01-28 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG47270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU17252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TG55276/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: YS21718
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21718%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for YS21718: 2
2026-01-28 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: TC75424
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC75424%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for TC75424: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: LP81684
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP81684%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for LP81684: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: MG09681
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG09681%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for MG09681: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: BH79865
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH79865%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for BH79865: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: BH83522
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH83522%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for BH83522: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: BU80810
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU80810%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for BU80810: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: BK36177
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK36177%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for BK36177: 2
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633683d0>
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg saved to cache
2026-01-28 17:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: WU13655
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for WU13655: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: ZH31906
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31906%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for ZH31906: 1
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: BK72365
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK72365%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for BK72365: 2
2026-01-28 17:04:17 [auto1.es] INFO: Found listing with ID: FF90378
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF90378%27 HTTP/1.1" 200 None
2026-01-28 17:04:17 [auto1.es] INFO: Scrape type for FF90378: 2
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a0df90>
2026-01-28 17:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg saved to cache
2026-01-28 17:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: LU21979
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU21979%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for LU21979: 2
2026-01-28 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG10753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: SF21345
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF21345%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for SF21345: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: BT53297
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for BT53297: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: DP23605
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP23605%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for DP23605: 2
2026-01-28 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX65685/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZN75442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: XG14528
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG14528%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for XG14528: 2
2026-01-28 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: DY06551
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY06551%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for DY06551: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: KX91354
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX91354%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for KX91354: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: ZU80420
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for ZU80420: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: HT97347
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for HT97347: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: AL42304
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL42304%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for AL42304: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: BG20996
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG20996%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for BG20996: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: FN63707
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN63707%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for FN63707: 1
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: WG59071
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for WG59071: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: VK58231
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK58231%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for VK58231: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: ZF50859
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF50859%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for ZF50859: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: VX11079
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX11079%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for VX11079: 1
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: LZ88191
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88191%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for LZ88191: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: CT67329
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT67329%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for CT67329: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: ZL80540
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for ZL80540: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: WF67982
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF67982%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for WF67982: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: PK27651
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for PK27651: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: NW01202
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW01202%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for NW01202: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: BU98177
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU98177%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for BU98177: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: TS38549
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS38549%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for TS38549: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: SW47045
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW47045%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for SW47045: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: JW59429
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW59429%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for JW59429: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: AR99640
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR99640%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for AR99640: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: SU04753
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU04753%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for SU04753: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: BB81076
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB81076%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for BB81076: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: YC26234
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for YC26234: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: YR92876
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR92876%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for YR92876: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: KX84601
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX84601%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for KX84601: 1
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: WB84696
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB84696%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for WB84696: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: TS18952
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for TS18952: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: YL11886
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL11886%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for YL11886: 1
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: ZL27489
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for ZL27489: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: ZV19691
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV19691%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for ZV19691: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: VV60127
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for VV60127: 2
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: CH50110
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for CH50110: 2
2026-01-28 17:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JK22212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: LJ42826
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ42826%27 HTTP/1.1" 200 None
2026-01-28 17:04:18 [auto1.es] INFO: Scrape type for LJ42826: 2
2026-01-28 17:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:18 [auto1.es] INFO: Found listing with ID: YT08561
2026-01-28 17:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for YT08561: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: FH92259
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for FH92259: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: NY63222
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY63222%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for NY63222: 1
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: LP03049
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP03049%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for LP03049: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: NA90839
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for NA90839: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: RY15229
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for RY15229: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: EU50952
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU50952%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for EU50952: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: KN94003
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN94003%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for KN94003: 1
2026-01-28 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP19820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: EN30281
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for EN30281: 2
2026-01-28 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: XG92427
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG92427%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for XG92427: 2
2026-01-28 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV91175/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: CL01909
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for CL01909: 2
2026-01-28 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: FB61251
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB61251%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for FB61251: 2
2026-01-28 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB59232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: CT76222
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT76222%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for CT76222: 2
2026-01-28 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: LK97600
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK97600%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for LK97600: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: YN61441
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN61441%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for YN61441: 1
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: BW23029
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW23029%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for BW23029: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: TV38062
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV38062%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for TV38062: 2
2026-01-28 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RT43870> (referer: https://www.auto1.com/v1/car-details-view/RT43870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: YW83541
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW83541%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for YW83541: 2
2026-01-28 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: RC89852
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC89852%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for RC89852: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: ZB83445
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for ZB83445: 2
2026-01-28 17:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL08796/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: PB42278
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for PB42278: 2
2026-01-28 17:04:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: VP08909
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP08909%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for VP08909: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: GH53615
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for GH53615: 2
2026-01-28 17:04:19 [auto1.es] INFO: Found listing with ID: DM35946
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM35946%27 HTTP/1.1" 200 None
2026-01-28 17:04:19 [auto1.es] INFO: Scrape type for DM35946: 2
2026-01-28 17:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7458e8-5342-5501-af00-7e13539677bb with identifier: RT43870
2026-01-28 17:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7458e8-5342-5501-af00-7e13539677bb with scrape type 2
2026-01-28 17:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7458e8-5342-5501-af00-7e13539677bb with scrape type 2
2026-01-28 17:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a7458e8-5342-5501-af00-7e13539677bb, identifier: RT43870
2026-01-28 17:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a7458e8-5342-5501-af00-7e13539677bb with identifier: RT43870
2026-01-28 17:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a7458e8-5342-5501-af00-7e13539677bb with identifier: RT43870
2026-01-28 17:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2a7458e8-5342-5501-af00-7e13539677bb with identifier: RT43870 to the API
2026-01-28 17:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RT43870>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:31:40Z',
 'fuel_type': 'petrol',
 'id': '2a7458e8-5342-5501-af00-7e13539677bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT43870',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 109423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2021}
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RT43870%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Saving data for RT43870: {'auction_closing_time': 1769704300.0, 'created_time': 1769003005.813714, 'last_price_update_time': 1769619860.245082}
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RT43870') HTTP/1.1" 204 0
2026-01-28 17:04:20 [auto1.es] INFO: Found listing with ID: FH58137
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH58137%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Scrape type for FH58137: 2
2026-01-28 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT25707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN18739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM39099/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:20 [auto1.es] INFO: Found listing with ID: WT57102
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT57102%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Scrape type for WT57102: 2
2026-01-28 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:20 [auto1.es] INFO: Found listing with ID: BW40922
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW40922%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Scrape type for BW40922: 2
2026-01-28 17:04:20 [auto1.es] INFO: Found listing with ID: CP16854
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16854%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Scrape type for CP16854: 2
2026-01-28 17:04:20 [auto1.es] INFO: Found listing with ID: RD19726
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-01-28 17:04:20 [auto1.es] INFO: Scrape type for RD19726: 2
2026-01-28 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC61871/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP16326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU21979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF90378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FS52760> (referer: https://www.auto1.com/v1/car-details-view/FS52760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH50110/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS34361> (referer: https://www.auto1.com/v1/car-details-view/TS34361/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with identifier: FS52760
2026-01-28 17:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with scrape type 2
2026-01-28 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with scrape type 2
2026-01-28 17:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd, identifier: FS52760
2026-01-28 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with identifier: FS52760
2026-01-28 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with identifier: FS52760
2026-01-28 17:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd with identifier: FS52760 to the API
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FS52760>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:44:46Z',
 'fuel_type': 'diesel',
 'id': '7c79d4dc-0b6f-5372-8ed4-e61b2d36f2dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS52760',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 93629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FS52760%27 HTTP/1.1" 200 None
2026-01-28 17:04:21 [auto1.es] INFO: Saving data for FS52760: {'auction_closing_time': 1769705086.0, 'created_time': 1768298844.247881, 'last_price_update_time': 1769619861.780364}
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FS52760') HTTP/1.1" 204 0
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RH54458> (referer: https://www.auto1.com/v1/car-details-view/RH54458/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU50952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 with identifier: TS34361
2026-01-28 17:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 with scrape type 2
2026-01-28 17:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 with scrape type 2
2026-01-28 17:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51, identifier: TS34361
2026-01-28 17:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 with identifier: TS34361
2026-01-28 17:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 with identifier: TS34361
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196682
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 spider: auto1.es
2026-01-28 17:04:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51 due to rule: high_mileage_for_country.json, error: 196682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196682
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:02:17Z',
 'fuel_type': 'diesel',
 'id': '091ce47d-d0f2-5ac5-ab87-7bb19d6d4d51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS34361',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS34361%27 HTTP/1.1" 200 None
2026-01-28 17:04:22 [auto1.es] INFO: Saving data for TS34361: {'auction_closing_time': 1769702537.0, 'created_time': 1769061734.254887, 'last_price_update_time': 1769619862.139359}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS34361') HTTP/1.1" 204 0
2026-01-28 17:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JK22212> (referer: https://www.auto1.com/v1/car-details-view/JK22212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19ef85f4-8bce-55bc-b423-1d78b0931d9b with identifier: RH54458
2026-01-28 17:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19ef85f4-8bce-55bc-b423-1d78b0931d9b with scrape type 2
2026-01-28 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19ef85f4-8bce-55bc-b423-1d78b0931d9b with scrape type 2
2026-01-28 17:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19ef85f4-8bce-55bc-b423-1d78b0931d9b, identifier: RH54458
2026-01-28 17:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19ef85f4-8bce-55bc-b423-1d78b0931d9b with identifier: RH54458
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19ef85f4-8bce-55bc-b423-1d78b0931d9b with identifier: RH54458
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168794 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168794
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 19ef85f4-8bce-55bc-b423-1d78b0931d9b spider: auto1.es
2026-01-28 17:04:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 19ef85f4-8bce-55bc-b423-1d78b0931d9b due to rule: high_mileage_for_country.json, error: 168794 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168794
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:51:29Z',
 'fuel_type': 'diesel',
 'id': '19ef85f4-8bce-55bc-b423-1d78b0931d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH54458',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 168794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 TDI Reference Plus',
 'transmission': 'manual',
 'trim': 'Reference Plus',
 'year': 2018}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RH54458%27 HTTP/1.1" 200 None
2026-01-28 17:04:22 [auto1.es] INFO: Saving data for RH54458: {'auction_closing_time': 1769705489.0, 'created_time': 1768928523.775581, 'last_price_update_time': 1769619862.487565}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RH54458') HTTP/1.1" 204 0
2026-01-28 17:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH58137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV38062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with identifier: JK22212
2026-01-28 17:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with scrape type 2
2026-01-28 17:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with scrape type 2
2026-01-28 17:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c108072-0c8b-54e7-8d18-5385bd2e0b32, identifier: JK22212
2026-01-28 17:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with identifier: JK22212
2026-01-28 17:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with identifier: JK22212
2026-01-28 17:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1c108072-0c8b-54e7-8d18-5385bd2e0b32 with identifier: JK22212 to the API
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JK22212>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 400,
 'expiration_date': '2026-01-29T16:00:42Z',
 'fuel_type': 'petrol',
 'id': '1c108072-0c8b-54e7-8d18-5385bd2e0b32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK22212',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 85351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JK22212%27 HTTP/1.1" 200 None
2026-01-28 17:04:22 [auto1.es] INFO: Saving data for JK22212: {'auction_closing_time': 1769702442.0, 'created_time': 1767703543.585217, 'last_price_update_time': 1769619862.980394}
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JK22212') HTTP/1.1" 204 0
2026-01-28 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB59232> (referer: https://www.auto1.com/v1/car-details-view/HB59232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM35946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH53615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15dedc85-74f7-5d77-8b2f-992f9b626539 with identifier: HB59232
2026-01-28 17:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15dedc85-74f7-5d77-8b2f-992f9b626539 with scrape type 2
2026-01-28 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15dedc85-74f7-5d77-8b2f-992f9b626539 with scrape type 2
2026-01-28 17:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15dedc85-74f7-5d77-8b2f-992f9b626539, identifier: HB59232
2026-01-28 17:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15dedc85-74f7-5d77-8b2f-992f9b626539 with identifier: HB59232
2026-01-28 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15dedc85-74f7-5d77-8b2f-992f9b626539 with identifier: HB59232
2026-01-28 17:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 15dedc85-74f7-5d77-8b2f-992f9b626539 with identifier: HB59232 to the API
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB59232>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 143,
 'expiration_date': '2026-01-29T16:42:12Z',
 'fuel_type': 'hybrid',
 'id': '15dedc85-74f7-5d77-8b2f-992f9b626539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB59232',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 38516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.6 Hybrid E-Tech Techno',
 'transmission': 'automatic',
 'trim': 'Techno',
 'year': 2023}
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB59232%27 HTTP/1.1" 200 None
2026-01-28 17:04:23 [auto1.es] INFO: Saving data for HB59232: {'auction_closing_time': 1769704932.0, 'created_time': 1769065307.43725, 'last_price_update_time': 1769619863.493669}
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB59232') HTTP/1.1" 204 0
2026-01-28 17:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM39099> (referer: https://www.auto1.com/v1/car-details-view/VM39099/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eff9db5c-94fe-5ea8-8378-f9838667e651 with identifier: VM39099
2026-01-28 17:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eff9db5c-94fe-5ea8-8378-f9838667e651 with scrape type 2
2026-01-28 17:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eff9db5c-94fe-5ea8-8378-f9838667e651 with scrape type 2
2026-01-28 17:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eff9db5c-94fe-5ea8-8378-f9838667e651, identifier: VM39099
2026-01-28 17:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eff9db5c-94fe-5ea8-8378-f9838667e651 with identifier: VM39099
2026-01-28 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eff9db5c-94fe-5ea8-8378-f9838667e651 with identifier: VM39099
2026-01-28 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2026-01-28 17:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: eff9db5c-94fe-5ea8-8378-f9838667e651 spider: auto1.es
2026-01-28 17:04:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: eff9db5c-94fe-5ea8-8378-f9838667e651 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:30:25Z',
 'fuel_type': 'diesel',
 'id': 'eff9db5c-94fe-5ea8-8378-f9838667e651',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM39099',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 122547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel Ka 35 C V Radstand 3520',
 'transmission': 'manual',
 'trim': 'Ka 35 C V Radstand 3520',
 'year': 2023}
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM39099%27 HTTP/1.1" 200 None
2026-01-28 17:04:23 [auto1.es] INFO: Saving data for VM39099: {'auction_closing_time': 1769704225.0, 'created_time': 1769447074.83645, 'last_price_update_time': 1769619863.951906}
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VM39099') HTTP/1.1" 204 0
2026-01-28 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN18739> (referer: https://www.auto1.com/v1/car-details-view/PN18739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL01909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add9270e-3068-5cef-a7d4-721210b643af with identifier: PN18739
2026-01-28 17:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add9270e-3068-5cef-a7d4-721210b643af with scrape type 2
2026-01-28 17:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add9270e-3068-5cef-a7d4-721210b643af with scrape type 2
2026-01-28 17:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: add9270e-3068-5cef-a7d4-721210b643af, identifier: PN18739
2026-01-28 17:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: add9270e-3068-5cef-a7d4-721210b643af with identifier: PN18739
2026-01-28 17:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: add9270e-3068-5cef-a7d4-721210b643af with identifier: PN18739
2026-01-28 17:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: add9270e-3068-5cef-a7d4-721210b643af with identifier: PN18739 to the API
2026-01-28 17:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PN18739>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:53:12Z',
 'fuel_type': 'petrol',
 'id': 'add9270e-3068-5cef-a7d4-721210b643af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN18739',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 113744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Super',
 'transmission': 'manual',
 'trim': 'Super',
 'year': 2019}
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PN18739%27 HTTP/1.1" 200 None
2026-01-28 17:04:26 [auto1.es] INFO: Saving data for PN18739: {'auction_closing_time': 1769705592.0, 'created_time': 1769447089.565392, 'last_price_update_time': 1769619866.56352}
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PN18739') HTTP/1.1" 204 0
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH50110> (referer: https://www.auto1.com/v1/car-details-view/CH50110/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP16326> (referer: https://www.auto1.com/v1/car-details-view/KP16326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF90378> (referer: https://www.auto1.com/v1/car-details-view/FF90378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT25707> (referer: https://www.auto1.com/v1/car-details-view/AT25707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU21979> (referer: https://www.auto1.com/v1/car-details-view/LU21979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC61871> (referer: https://www.auto1.com/v1/car-details-view/WC61871/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-01-28 17:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2026-01-28 17:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35cb1834-e1ac-5552-96c3-6d17f8986e21 with scrape type 2
2026-01-28 17:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 35cb1834-e1ac-5552-96c3-6d17f8986e21, identifier: CH50110
2026-01-28 17:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-01-28 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 with identifier: CH50110
2026-01-28 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193064
2026-01-28 17:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 35cb1834-e1ac-5552-96c3-6d17f8986e21 spider: auto1.es
2026-01-28 17:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 35cb1834-e1ac-5552-96c3-6d17f8986e21 due to rule: high_mileage_for_country.json, error: 193064 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193064
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:39:15Z',
 'fuel_type': 'diesel',
 'id': '35cb1834-e1ac-5552-96c3-6d17f8986e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH50110',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 193064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH50110%27 HTTP/1.1" 200 None
2026-01-28 17:04:26 [auto1.es] INFO: Saving data for CH50110: {'auction_closing_time': 1769704755.0, 'created_time': 1768237626.485895, 'last_price_update_time': 1769619866.998576}
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH50110') HTTP/1.1" 204 0
2026-01-28 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc252478-f30d-52bc-94d9-eb1d85a50a11 with identifier: KP16326
2026-01-28 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc252478-f30d-52bc-94d9-eb1d85a50a11 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc252478-f30d-52bc-94d9-eb1d85a50a11 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc252478-f30d-52bc-94d9-eb1d85a50a11, identifier: KP16326
2026-01-28 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769cfc46-d438-5d97-a8e0-12f6bbceca57 with identifier: FF90378
2026-01-28 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769cfc46-d438-5d97-a8e0-12f6bbceca57 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769cfc46-d438-5d97-a8e0-12f6bbceca57 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 769cfc46-d438-5d97-a8e0-12f6bbceca57, identifier: FF90378
2026-01-28 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with identifier: AT25707
2026-01-28 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ed6d71f-e951-55d0-8632-cfeadf5cc963, identifier: AT25707
2026-01-28 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da4f8f02-4234-576a-acb8-2b0df012c319 with identifier: LU21979
2026-01-28 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da4f8f02-4234-576a-acb8-2b0df012c319 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da4f8f02-4234-576a-acb8-2b0df012c319 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: da4f8f02-4234-576a-acb8-2b0df012c319, identifier: LU21979
2026-01-28 17:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91260896-087f-58a0-b92f-0247135c0d79 with identifier: WC61871
2026-01-28 17:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91260896-087f-58a0-b92f-0247135c0d79 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91260896-087f-58a0-b92f-0247135c0d79 with scrape type 2
2026-01-28 17:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91260896-087f-58a0-b92f-0247135c0d79, identifier: WC61871
2026-01-28 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc252478-f30d-52bc-94d9-eb1d85a50a11 with identifier: KP16326
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc252478-f30d-52bc-94d9-eb1d85a50a11 with identifier: KP16326
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153254 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153254
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dc252478-f30d-52bc-94d9-eb1d85a50a11 spider: auto1.es
2026-01-28 17:04:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dc252478-f30d-52bc-94d9-eb1d85a50a11 due to rule: high_mileage_for_country.json, error: 153254 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153254
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:05:08Z',
 'fuel_type': 'diesel',
 'id': 'dc252478-f30d-52bc-94d9-eb1d85a50a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP16326',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 153254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Business 4WD',
 'transmission': 'manual',
 'trim': 'Business 4WD',
 'year': 2021}
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP16326%27 HTTP/1.1" 200 None
2026-01-28 17:04:27 [auto1.es] INFO: Saving data for KP16326: {'auction_closing_time': 1769702708.0, 'created_time': 1767978315.542424, 'last_price_update_time': 1769619867.689494}
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KP16326') HTTP/1.1" 204 0
2026-01-28 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 769cfc46-d438-5d97-a8e0-12f6bbceca57 with identifier: FF90378
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 769cfc46-d438-5d97-a8e0-12f6bbceca57 with identifier: FF90378
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 769cfc46-d438-5d97-a8e0-12f6bbceca57 spider: auto1.es
2026-01-28 17:04:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 769cfc46-d438-5d97-a8e0-12f6bbceca57 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:03:43Z',
 'fuel_type': 'diesel',
 'id': '769cfc46-d438-5d97-a8e0-12f6bbceca57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF90378',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 157892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-08',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2022}
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FF90378%27 HTTP/1.1" 200 None
2026-01-28 17:04:27 [auto1.es] INFO: Saving data for FF90378: {'auction_closing_time': 1769702623.0, 'created_time': 1769447347.083953, 'last_price_update_time': 1769619867.920558}
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FF90378') HTTP/1.1" 204 0
2026-01-28 17:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with identifier: AT25707
2026-01-28 17:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with identifier: AT25707
2026-01-28 17:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ed6d71f-e951-55d0-8632-cfeadf5cc963 with identifier: AT25707 to the API
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AT25707>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:11:07Z',
 'fuel_type': 'diesel',
 'id': '1ed6d71f-e951-55d0-8632-cfeadf5cc963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT25707',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 97209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AT25707%27 HTTP/1.1" 200 None
2026-01-28 17:04:28 [auto1.es] INFO: Saving data for AT25707: {'auction_closing_time': 1769703067.0, 'created_time': 1768237411.760617, 'last_price_update_time': 1769619868.254271}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AT25707') HTTP/1.1" 204 0
2026-01-28 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: da4f8f02-4234-576a-acb8-2b0df012c319 with identifier: LU21979
2026-01-28 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: da4f8f02-4234-576a-acb8-2b0df012c319 with identifier: LU21979
2026-01-28 17:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: da4f8f02-4234-576a-acb8-2b0df012c319 with identifier: LU21979 to the API
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LU21979>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'da4f8f02-4234-576a-acb8-2b0df012c319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU21979',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 67952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LU21979%27 HTTP/1.1" 200 None
2026-01-28 17:04:28 [auto1.es] INFO: Saving data for LU21979: {'auction_closing_time': 1769704391.0, 'created_time': 1768825896.17641, 'last_price_update_time': 1769619868.603722}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LU21979') HTTP/1.1" 204 0
2026-01-28 17:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91260896-087f-58a0-b92f-0247135c0d79 with identifier: WC61871
2026-01-28 17:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91260896-087f-58a0-b92f-0247135c0d79 with identifier: WC61871
2026-01-28 17:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 91260896-087f-58a0-b92f-0247135c0d79 with identifier: WC61871 to the API
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WC61871>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 80,
 'expiration_date': '2026-01-29T16:11:19Z',
 'fuel_type': 'petrol',
 'id': '91260896-087f-58a0-b92f-0247135c0d79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC61871',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 5828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Style XM',
 'transmission': 'manual',
 'trim': 'Style XM',
 'year': 2023}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WC61871%27 HTTP/1.1" 200 None
2026-01-28 17:04:28 [auto1.es] INFO: Saving data for WC61871: {'auction_closing_time': 1769703079.0, 'created_time': 1769003033.306325, 'last_price_update_time': 1769619868.97074}
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WC61871') HTTP/1.1" 204 0
2026-01-28 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP16854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD19726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW40922/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU50952> (referer: https://www.auto1.com/v1/car-details-view/EU50952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV38062> (referer: https://www.auto1.com/v1/car-details-view/TV38062/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL08796> (referer: https://www.auto1.com/v1/car-details-view/YL08796/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2026-01-28 17:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1de5218-b4f3-50e8-aeeb-1660b7498394 with scrape type 2
2026-01-28 17:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1de5218-b4f3-50e8-aeeb-1660b7498394 with scrape type 2
2026-01-28 17:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d1de5218-b4f3-50e8-aeeb-1660b7498394, identifier: EU50952
2026-01-28 17:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2026-01-28 17:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d1de5218-b4f3-50e8-aeeb-1660b7498394 with identifier: EU50952
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: d1de5218-b4f3-50e8-aeeb-1660b7498394 spider: auto1.es
2026-01-28 17:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d1de5218-b4f3-50e8-aeeb-1660b7498394 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:28:05Z',
 'fuel_type': 'electro',
 'id': 'd1de5218-b4f3-50e8-aeeb-1660b7498394',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU50952',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 26718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EU50952%27 HTTP/1.1" 200 None
2026-01-28 17:04:30 [auto1.es] INFO: Saving data for EU50952: {'auction_closing_time': 1769704085.0, 'created_time': 1768237590.78527, 'last_price_update_time': 1769619870.143324}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EU50952') HTTP/1.1" 204 0
2026-01-28 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM35946> (referer: https://www.auto1.com/v1/car-details-view/DM35946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH58137> (referer: https://www.auto1.com/v1/car-details-view/FH58137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH53615> (referer: https://www.auto1.com/v1/car-details-view/GH53615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4bf6007-257f-520b-b8fe-7a199a5644d4 with identifier: TV38062
2026-01-28 17:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4bf6007-257f-520b-b8fe-7a199a5644d4 with scrape type 2
2026-01-28 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4bf6007-257f-520b-b8fe-7a199a5644d4 with scrape type 2
2026-01-28 17:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4bf6007-257f-520b-b8fe-7a199a5644d4, identifier: TV38062
2026-01-28 17:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8ff439-a387-5bda-9b13-f943c257ef49 with identifier: YL08796
2026-01-28 17:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8ff439-a387-5bda-9b13-f943c257ef49 with scrape type 2
2026-01-28 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc8ff439-a387-5bda-9b13-f943c257ef49 with scrape type 2
2026-01-28 17:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc8ff439-a387-5bda-9b13-f943c257ef49, identifier: YL08796
2026-01-28 17:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4bf6007-257f-520b-b8fe-7a199a5644d4 with identifier: TV38062
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4bf6007-257f-520b-b8fe-7a199a5644d4 with identifier: TV38062
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165307 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165307
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e4bf6007-257f-520b-b8fe-7a199a5644d4 spider: auto1.es
2026-01-28 17:04:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e4bf6007-257f-520b-b8fe-7a199a5644d4 due to rule: high_mileage_for_country.json, error: 165307 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165307
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:13:49Z',
 'fuel_type': 'diesel',
 'id': 'e4bf6007-257f-520b-b8fe-7a199a5644d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV38062',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 165307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV38062%27 HTTP/1.1" 200 None
2026-01-28 17:04:30 [auto1.es] INFO: Saving data for TV38062: {'auction_closing_time': 1769703229.0, 'created_time': 1768410286.721772, 'last_price_update_time': 1769619870.56441}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV38062') HTTP/1.1" 204 0
2026-01-28 17:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc8ff439-a387-5bda-9b13-f943c257ef49 with identifier: YL08796
2026-01-28 17:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc8ff439-a387-5bda-9b13-f943c257ef49 with identifier: YL08796
2026-01-28 17:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc8ff439-a387-5bda-9b13-f943c257ef49 with identifier: YL08796 to the API
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL08796>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:09:25Z',
 'fuel_type': 'diesel',
 'id': 'bc8ff439-a387-5bda-9b13-f943c257ef49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL08796',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 87344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL08796%27 HTTP/1.1" 200 None
2026-01-28 17:04:30 [auto1.es] INFO: Saving data for YL08796: {'auction_closing_time': 1769702965.0, 'created_time': 1768237416.802698, 'last_price_update_time': 1769619870.90258}
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YL08796') HTTP/1.1" 204 0
2026-01-28 17:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP08909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f21c3efe-08a8-585c-9442-a4271f7e98b4 with identifier: DM35946
2026-01-28 17:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f21c3efe-08a8-585c-9442-a4271f7e98b4 with scrape type 2
2026-01-28 17:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f21c3efe-08a8-585c-9442-a4271f7e98b4 with scrape type 2
2026-01-28 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f21c3efe-08a8-585c-9442-a4271f7e98b4, identifier: DM35946
2026-01-28 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with identifier: FH58137
2026-01-28 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with scrape type 2
2026-01-28 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with scrape type 2
2026-01-28 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 236f4881-3b1e-5bc9-a4a7-b38bd4826354, identifier: FH58137
2026-01-28 17:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-01-28 17:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e6570f-3788-55ab-9ffc-15c957f83a12 with scrape type 2
2026-01-28 17:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65e6570f-3788-55ab-9ffc-15c957f83a12 with scrape type 2
2026-01-28 17:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65e6570f-3788-55ab-9ffc-15c957f83a12, identifier: GH53615
2026-01-28 17:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f21c3efe-08a8-585c-9442-a4271f7e98b4 with identifier: DM35946
2026-01-28 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f21c3efe-08a8-585c-9442-a4271f7e98b4 with identifier: DM35946
2026-01-28 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164159 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164159
2026-01-28 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f21c3efe-08a8-585c-9442-a4271f7e98b4 spider: auto1.es
2026-01-28 17:04:31 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f21c3efe-08a8-585c-9442-a4271f7e98b4 due to rule: high_mileage_for_country.json, error: 164159 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164159
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:43:56Z',
 'fuel_type': 'hybrid',
 'id': 'f21c3efe-08a8-585c-9442-a4271f7e98b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM35946',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Lexus',
 'model': 'CT-Serie',
 'odometer': 164159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Lexus CT-Serie CT 200h',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-28 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM35946%27 HTTP/1.1" 200 None
2026-01-28 17:04:31 [auto1.es] INFO: Saving data for DM35946: {'auction_closing_time': 1769705036.0, 'created_time': 1767961979.112315, 'last_price_update_time': 1769619871.794056}
2026-01-28 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM35946') HTTP/1.1" 204 0
2026-01-28 17:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with identifier: FH58137
2026-01-28 17:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with identifier: FH58137
2026-01-28 17:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 236f4881-3b1e-5bc9-a4a7-b38bd4826354 with identifier: FH58137 to the API
2026-01-28 17:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FH58137>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:56:09Z',
 'fuel_type': 'diesel',
 'id': '236f4881-3b1e-5bc9-a4a7-b38bd4826354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH58137',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': '1er',
 'odometer': 36113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH58137%27 HTTP/1.1" 200 None
2026-01-28 17:04:32 [auto1.es] INFO: Saving data for FH58137: {'auction_closing_time': 1769705769.0, 'created_time': 1767962116.379627, 'last_price_update_time': 1769619872.140168}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH58137') HTTP/1.1" 204 0
2026-01-28 17:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-01-28 17:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615
2026-01-28 17:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65e6570f-3788-55ab-9ffc-15c957f83a12 with identifier: GH53615 to the API
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GH53615>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:23:23Z',
 'fuel_type': 'diesel',
 'id': '65e6570f-3788-55ab-9ffc-15c957f83a12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH53615',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 132314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH53615%27 HTTP/1.1" 200 None
2026-01-28 17:04:32 [auto1.es] INFO: Saving data for GH53615: {'auction_closing_time': 1769703803.0, 'created_time': 1768410357.282502, 'last_price_update_time': 1769619872.456738}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH53615') HTTP/1.1" 204 0
2026-01-28 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB83445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB42278/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL01909> (referer: https://www.auto1.com/v1/car-details-view/CL01909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WT57102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2026-01-28 17:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e832be-06b0-50da-87ca-87a33eb3edf0 with scrape type 2
2026-01-28 17:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e832be-06b0-50da-87ca-87a33eb3edf0 with scrape type 2
2026-01-28 17:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0e832be-06b0-50da-87ca-87a33eb3edf0, identifier: CL01909
2026-01-28 17:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2026-01-28 17:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0e832be-06b0-50da-87ca-87a33eb3edf0 with identifier: CL01909
2026-01-28 17:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2026-01-28 17:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a0e832be-06b0-50da-87ca-87a33eb3edf0 spider: auto1.es
2026-01-28 17:04:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a0e832be-06b0-50da-87ca-87a33eb3edf0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:06:36Z',
 'fuel_type': 'electro',
 'id': 'a0e832be-06b0-50da-87ca-87a33eb3edf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL01909',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 26150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL01909%27 HTTP/1.1" 200 None
2026-01-28 17:04:32 [auto1.es] INFO: Saving data for CL01909: {'auction_closing_time': 1769702796.0, 'created_time': 1768237632.072674, 'last_price_update_time': 1769619872.889733}
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL01909') HTTP/1.1" 204 0
2026-01-28 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC89852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW23029/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP19820> (referer: https://www.auto1.com/v1/car-details-view/TP19820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD19726> (referer: https://www.auto1.com/v1/car-details-view/RD19726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW40922> (referer: https://www.auto1.com/v1/car-details-view/BW40922/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-01-28 17:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with scrape type 2
2026-01-28 17:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with scrape type 2
2026-01-28 17:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a, identifier: TP19820
2026-01-28 17:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-01-28 17:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820
2026-01-28 17:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e50a90be-dc51-5e36-9bd1-a2b4e911cb1a with identifier: TP19820 to the API
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP19820>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:30:08Z',
 'fuel_type': 'diesel',
 'id': 'e50a90be-dc51-5e36-9bd1-a2b4e911cb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP19820',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 76060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP19820%27 HTTP/1.1" 200 None
2026-01-28 17:04:34 [auto1.es] INFO: Saving data for TP19820: {'auction_closing_time': 1769704208.0, 'created_time': 1768237419.351077, 'last_price_update_time': 1769619874.251618}
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP19820') HTTP/1.1" 204 0
2026-01-28 17:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN61441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-01-28 17:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d970894e-a931-57a2-ada4-e9528d89f809 with scrape type 2
2026-01-28 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d970894e-a931-57a2-ada4-e9528d89f809 with scrape type 2
2026-01-28 17:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d970894e-a931-57a2-ada4-e9528d89f809, identifier: RD19726
2026-01-28 17:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with identifier: BW40922
2026-01-28 17:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with scrape type 2
2026-01-28 17:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with scrape type 2
2026-01-28 17:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b12bd597-27ac-51f4-8c4a-80b1fc8954e7, identifier: BW40922
2026-01-28 17:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-01-28 17:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726
2026-01-28 17:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d970894e-a931-57a2-ada4-e9528d89f809 with identifier: RD19726 to the API
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD19726>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:04:19Z',
 'fuel_type': 'diesel',
 'id': 'd970894e-a931-57a2-ada4-e9528d89f809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD19726',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 125108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Trend Plus',
 'transmission': 'manual',
 'trim': 'Trend Plus',
 'year': 2022}
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-01-28 17:04:34 [auto1.es] INFO: Saving data for RD19726: {'auction_closing_time': 1769702659.0, 'created_time': 1768410457.630365, 'last_price_update_time': 1769619874.773887}
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RD19726') HTTP/1.1" 204 0
2026-01-28 17:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with identifier: BW40922
2026-01-28 17:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with identifier: BW40922
2026-01-28 17:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b12bd597-27ac-51f4-8c4a-80b1fc8954e7 with identifier: BW40922 to the API
2026-01-28 17:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW40922>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:01:31Z',
 'fuel_type': 'diesel',
 'id': 'b12bd597-27ac-51f4-8c4a-80b1fc8954e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW40922',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 75106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW40922%27 HTTP/1.1" 200 None
2026-01-28 17:04:35 [auto1.es] INFO: Saving data for BW40922: {'auction_closing_time': 1769702491.0, 'created_time': 1768410582.163478, 'last_price_update_time': 1769619875.168291}
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BW40922') HTTP/1.1" 204 0
2026-01-28 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP16854> (referer: https://www.auto1.com/v1/car-details-view/CP16854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK97600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV91175> (referer: https://www.auto1.com/v1/car-details-view/RV91175/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98171940-b96a-5294-9d73-e9b46b8b9f9f with identifier: CP16854
2026-01-28 17:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98171940-b96a-5294-9d73-e9b46b8b9f9f with scrape type 2
2026-01-28 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98171940-b96a-5294-9d73-e9b46b8b9f9f with scrape type 2
2026-01-28 17:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 98171940-b96a-5294-9d73-e9b46b8b9f9f, identifier: CP16854
2026-01-28 17:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 98171940-b96a-5294-9d73-e9b46b8b9f9f with identifier: CP16854
2026-01-28 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 98171940-b96a-5294-9d73-e9b46b8b9f9f with identifier: CP16854
2026-01-28 17:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 98171940-b96a-5294-9d73-e9b46b8b9f9f with identifier: CP16854 to the API
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP16854>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:47:14Z',
 'fuel_type': 'diesel',
 'id': '98171940-b96a-5294-9d73-e9b46b8b9f9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP16854',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 113563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP16854%27 HTTP/1.1" 200 None
2026-01-28 17:04:35 [auto1.es] INFO: Saving data for CP16854: {'auction_closing_time': 1769705234.0, 'created_time': 1769493860.568587, 'last_price_update_time': 1769619875.704493}
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CP16854') HTTP/1.1" 204 0
2026-01-28 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG92427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW83541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5478d658-7a14-5229-9f08-94e6b2a55fcd with identifier: RV91175
2026-01-28 17:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5478d658-7a14-5229-9f08-94e6b2a55fcd with scrape type 2
2026-01-28 17:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5478d658-7a14-5229-9f08-94e6b2a55fcd with scrape type 2
2026-01-28 17:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5478d658-7a14-5229-9f08-94e6b2a55fcd, identifier: RV91175
2026-01-28 17:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5478d658-7a14-5229-9f08-94e6b2a55fcd with identifier: RV91175
2026-01-28 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5478d658-7a14-5229-9f08-94e6b2a55fcd with identifier: RV91175
2026-01-28 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 136848 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136848
2026-01-28 17:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 5478d658-7a14-5229-9f08-94e6b2a55fcd spider: auto1.es
2026-01-28 17:04:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5478d658-7a14-5229-9f08-94e6b2a55fcd due to rule: high_mileage_for_make.json, error: 136848 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    136848
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:10:03Z',
 'fuel_type': 'diesel',
 'id': '5478d658-7a14-5229-9f08-94e6b2a55fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV91175',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 136848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-28 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV91175%27 HTTP/1.1" 200 None
2026-01-28 17:04:36 [auto1.es] INFO: Saving data for RV91175: {'auction_closing_time': 1769703003.0, 'created_time': 1769015059.464138, 'last_price_update_time': 1769619876.073159}
2026-01-28 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV91175') HTTP/1.1" 204 0
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB61251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT76222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN30281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN94003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC89852> (referer: https://www.auto1.com/v1/car-details-view/RC89852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WT57102> (referer: https://www.auto1.com/v1/car-details-view/WT57102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with identifier: RC89852
2026-01-28 17:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with scrape type 2
2026-01-28 17:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with scrape type 2
2026-01-28 17:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d, identifier: RC89852
2026-01-28 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with identifier: RC89852
2026-01-28 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with identifier: RC89852
2026-01-28 17:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08fa7e2f-d0f1-59e3-8c9a-ac051d09490d with identifier: RC89852 to the API
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RC89852>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:03:14Z',
 'fuel_type': 'diesel',
 'id': '08fa7e2f-d0f1-59e3-8c9a-ac051d09490d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC89852',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 117010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RC89852%27 HTTP/1.1" 200 None
2026-01-28 17:04:37 [auto1.es] INFO: Saving data for RC89852: {'auction_closing_time': 1769702594.0, 'created_time': 1768410290.805897, 'last_price_update_time': 1769619877.39159}
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RC89852') HTTP/1.1" 204 0
2026-01-28 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW23029> (referer: https://www.auto1.com/v1/car-details-view/BW23029/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP08909> (referer: https://www.auto1.com/v1/car-details-view/VP08909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with identifier: WT57102
2026-01-28 17:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with scrape type 2
2026-01-28 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with scrape type 2
2026-01-28 17:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ab8bd6cf-b636-509e-8f7f-3d7d0d34b403, identifier: WT57102
2026-01-28 17:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with identifier: WT57102
2026-01-28 17:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with identifier: WT57102
2026-01-28 17:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ab8bd6cf-b636-509e-8f7f-3d7d0d34b403 with identifier: WT57102 to the API
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WT57102>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:13:22Z',
 'fuel_type': 'diesel',
 'id': 'ab8bd6cf-b636-509e-8f7f-3d7d0d34b403',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT57102',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 101336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WT57102%27 HTTP/1.1" 200 None
2026-01-28 17:04:37 [auto1.es] INFO: Saving data for WT57102: {'auction_closing_time': 1769703202.0, 'created_time': 1768410303.949048, 'last_price_update_time': 1769619877.885273}
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WT57102') HTTP/1.1" 204 0
2026-01-28 17:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA90839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d9b1414-1762-5e2c-926e-b12f8461a68c with identifier: BW23029
2026-01-28 17:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d9b1414-1762-5e2c-926e-b12f8461a68c with scrape type 2
2026-01-28 17:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d9b1414-1762-5e2c-926e-b12f8461a68c with scrape type 2
2026-01-28 17:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d9b1414-1762-5e2c-926e-b12f8461a68c, identifier: BW23029
2026-01-28 17:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with identifier: VP08909
2026-01-28 17:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with scrape type 2
2026-01-28 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with scrape type 2
2026-01-28 17:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 670bfc17-3445-59e7-b17f-504ce7fc4ae3, identifier: VP08909
2026-01-28 17:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d9b1414-1762-5e2c-926e-b12f8461a68c with identifier: BW23029
2026-01-28 17:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d9b1414-1762-5e2c-926e-b12f8461a68c with identifier: BW23029
2026-01-28 17:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2d9b1414-1762-5e2c-926e-b12f8461a68c with identifier: BW23029 to the API
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW23029>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:46:12Z',
 'fuel_type': 'diesel',
 'id': '2d9b1414-1762-5e2c-926e-b12f8461a68c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW23029',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '1er',
 'odometer': 38559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BW23029%27 HTTP/1.1" 200 None
2026-01-28 17:04:38 [auto1.es] INFO: Saving data for BW23029: {'auction_closing_time': 1769705172.0, 'created_time': 1769148213.971416, 'last_price_update_time': 1769619878.461365}
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BW23029') HTTP/1.1" 204 0
2026-01-28 17:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with identifier: VP08909
2026-01-28 17:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with identifier: VP08909
2026-01-28 17:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 670bfc17-3445-59e7-b17f-504ce7fc4ae3 with identifier: VP08909 to the API
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP08909>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:34:03Z',
 'fuel_type': 'diesel',
 'id': '670bfc17-3445-59e7-b17f-504ce7fc4ae3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP08909',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 25715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP08909%27 HTTP/1.1" 200 None
2026-01-28 17:04:38 [auto1.es] INFO: Saving data for VP08909: {'auction_closing_time': 1769704443.0, 'created_time': 1768410465.026016, 'last_price_update_time': 1769619878.77426}
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VP08909') HTTP/1.1" 204 0
2026-01-28 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP03049/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY63222/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY15229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB42278> (referer: https://www.auto1.com/v1/car-details-view/PB42278/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-01-28 17:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with scrape type 2
2026-01-28 17:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with scrape type 2
2026-01-28 17:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2, identifier: PB42278
2026-01-28 17:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-01-28 17:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278
2026-01-28 17:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7807f7f-72ea-5f4e-8afb-386f63a0e8c2 with identifier: PB42278 to the API
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PB42278>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:29:10Z',
 'fuel_type': 'diesel',
 'id': 'd7807f7f-72ea-5f4e-8afb-386f63a0e8c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB42278',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 68590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB42278%27 HTTP/1.1" 200 None
2026-01-28 17:04:39 [auto1.es] INFO: Saving data for PB42278: {'auction_closing_time': 1769704150.0, 'created_time': 1768410292.803496, 'last_price_update_time': 1769619879.363759}
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PB42278') HTTP/1.1" 204 0
2026-01-28 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB83445> (referer: https://www.auto1.com/v1/car-details-view/ZB83445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH92259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK97600> (referer: https://www.auto1.com/v1/car-details-view/LK97600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-01-28 17:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e477789a-64d8-5ecc-806c-30aa8e4e7f48 with scrape type 2
2026-01-28 17:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e477789a-64d8-5ecc-806c-30aa8e4e7f48 with scrape type 2
2026-01-28 17:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e477789a-64d8-5ecc-806c-30aa8e4e7f48, identifier: ZB83445
2026-01-28 17:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-01-28 17:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445
2026-01-28 17:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e477789a-64d8-5ecc-806c-30aa8e4e7f48 with identifier: ZB83445 to the API
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZB83445>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 404,
 'expiration_date': '2026-01-29T16:05:33Z',
 'fuel_type': 'hybrid',
 'id': 'e477789a-64d8-5ecc-806c-30aa8e4e7f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB83445',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 68726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar F-Pace P400e Plug-in Hybrid R-Dynamic S AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic S AWD',
 'year': 2023}
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB83445%27 HTTP/1.1" 200 None
2026-01-28 17:04:39 [auto1.es] INFO: Saving data for ZB83445: {'auction_closing_time': 1769702733.0, 'created_time': 1768410310.836427, 'last_price_update_time': 1769619879.97904}
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZB83445') HTTP/1.1" 204 0
2026-01-28 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT08561/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN61441> (referer: https://www.auto1.com/v1/car-details-view/YN61441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 with identifier: LK97600
2026-01-28 17:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 with scrape type 2
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 with scrape type 2
2026-01-28 17:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4, identifier: LK97600
2026-01-28 17:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 with identifier: LK97600
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 with identifier: LK97600
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 119707, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lk97600', 'expiration_date': '2026-01-29t16:31:25z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 119707}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:31:25z',
     'fuel_type': 'electro',
     'id': '8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lk97600',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 119707,
     'odometer_in_km': 119707,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-13',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 spider: auto1.es
2026-01-28 17:04:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 119707, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lk97600', 'expiration_date': '2026-01-29t16:31:25z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 119707}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:31:25z',
     'fuel_type': 'electro',
     'id': '8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lk97600',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 119707,
     'odometer_in_km': 119707,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-13',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:31:25Z',
 'fuel_type': 'electro',
 'id': '8e00e2d1-c5d7-5d6d-ad8b-1cf3fb9878a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK97600',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 119707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LK97600%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [auto1.es] INFO: Saving data for LK97600: {'auction_closing_time': 1769704285.0, 'created_time': 1769101434.905595, 'last_price_update_time': 1769619880.304602}
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LK97600') HTTP/1.1" 204 0
2026-01-28 17:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN30281> (referer: https://www.auto1.com/v1/car-details-view/EN30281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3550d89a-d93e-5e81-8c8c-46f3adc1c894 with identifier: YN61441
2026-01-28 17:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3550d89a-d93e-5e81-8c8c-46f3adc1c894 with scrape type 1
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3550d89a-d93e-5e81-8c8c-46f3adc1c894
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_e6d7e480b68a8f801f57d5feed0cd4c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_e6d7e480b68a8f801f57d5feed0cd4c6.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_ac39abaee685a197ba4b45c9597587d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ac39abaee685a197ba4b45c9597587d8.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_444e593049601ce8b10041830c834b21.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_444e593049601ce8b10041830c834b21.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_2a5abf4d88403c2afe7f1c829f7fbc10.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_2a5abf4d88403c2afe7f1c829f7fbc10.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_99217f1d77e6144321dcbfbef7e36985.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_99217f1d77e6144321dcbfbef7e36985.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_4c95b393a119cbea56f49318814ea231.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_4c95b393a119cbea56f49318814ea231.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_1cd1b899ec145be7d7c22b3aa9ca7d7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1cd1b899ec145be7d7c22b3aa9ca7d7c.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_cfa306656138017e117e7e6693783d10.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_cfa306656138017e117e7e6693783d10.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_c59d85740590f39c1782d23185ff2761.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c59d85740590f39c1782d23185ff2761.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_9c0d90c98a53342dc58673de4dbdfbbb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_9c0d90c98a53342dc58673de4dbdfbbb.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_1a4cb8b848a2b757c79248dff4adaee6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1a4cb8b848a2b757c79248dff4adaee6.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_5bf45f4cd227a9fa26d98b84ef991614.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5bf45f4cd227a9fa26d98b84ef991614.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_ffcd191524e71566492bb4c342bfde4f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ffcd191524e71566492bb4c342bfde4f.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_5df5cf302dcc88008bfc7f7f98ac4555.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5df5cf302dcc88008bfc7f7f98ac4555.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_7a27090a0e0cc9c4f5399dbeb12362c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_7a27090a0e0cc9c4f5399dbeb12362c7.jpg already downloaded
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fe7%252Fe4e73143c723a18454447787bc8313c2%252Fpa%252FYN61441_c08013ebbe44f8b447cc7e7025fe6580.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c08013ebbe44f8b447cc7e7025fe6580.jpg already downloaded
2026-01-28 17:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3550d89a-d93e-5e81-8c8c-46f3adc1c894, identifier: YN61441
2026-01-28 17:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3550d89a-d93e-5e81-8c8c-46f3adc1c894 with identifier: YN61441
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3550d89a-d93e-5e81-8c8c-46f3adc1c894 with identifier: YN61441
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162119 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162119
2026-01-28 17:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3550d89a-d93e-5e81-8c8c-46f3adc1c894 spider: auto1.es
2026-01-28 17:04:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3550d89a-d93e-5e81-8c8c-46f3adc1c894 due to rule: high_mileage_for_country.json, error: 162119 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162119
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:10:04Z',
 'fuel_type': 'petrol',
 'id': '3550d89a-d93e-5e81-8c8c-46f3adc1c894',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN61441',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 162119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_e6d7e480b68a8f801f57d5feed0cd4c6.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ac39abaee685a197ba4b45c9597587d8.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_444e593049601ce8b10041830c834b21.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_2a5abf4d88403c2afe7f1c829f7fbc10.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_99217f1d77e6144321dcbfbef7e36985.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_4c95b393a119cbea56f49318814ea231.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1cd1b899ec145be7d7c22b3aa9ca7d7c.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_cfa306656138017e117e7e6693783d10.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c59d85740590f39c1782d23185ff2761.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_9c0d90c98a53342dc58673de4dbdfbbb.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1a4cb8b848a2b757c79248dff4adaee6.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5bf45f4cd227a9fa26d98b84ef991614.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ffcd191524e71566492bb4c342bfde4f.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5df5cf302dcc88008bfc7f7f98ac4555.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_7a27090a0e0cc9c4f5399dbeb12362c7.jpg',
                'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c08013ebbe44f8b447cc7e7025fe6580.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_e6d7e480b68a8f801f57d5feed0cd4c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ac39abaee685a197ba4b45c9597587d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_444e593049601ce8b10041830c834b21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_2a5abf4d88403c2afe7f1c829f7fbc10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_99217f1d77e6144321dcbfbef7e36985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_4c95b393a119cbea56f49318814ea231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1cd1b899ec145be7d7c22b3aa9ca7d7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_cfa306656138017e117e7e6693783d10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c59d85740590f39c1782d23185ff2761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_9c0d90c98a53342dc58673de4dbdfbbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_1a4cb8b848a2b757c79248dff4adaee6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5bf45f4cd227a9fa26d98b84ef991614.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_ffcd191524e71566492bb4c342bfde4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_5df5cf302dcc88008bfc7f7f98ac4555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52537,
             'Height': 527,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_7a27090a0e0cc9c4f5399dbeb12362c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3550d89a-d93e-5e81-8c8c-46f3adc1c894/3550d89a-d93e-5e81-8c8c-46f3adc1c894_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/e7/e4e73143c723a18454447787bc8313c2/pa/YN61441_c08013ebbe44f8b447cc7e7025fe6580.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 bivalent Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-01-28 17:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN61441%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [auto1.es] INFO: Saving data for YN61441: {'created_time': 1769619881.007002, 'last_price_update_time': 1769619881.007012, 'auction_closing_time': 1769703004.0}
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN61441') HTTP/1.1" 204 0
2026-01-28 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN94003> (referer: https://www.auto1.com/v1/car-details-view/KN94003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2026-01-28 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7836ce4-1230-5398-9762-87ddca840239 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7836ce4-1230-5398-9762-87ddca840239 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7836ce4-1230-5398-9762-87ddca840239, identifier: EN30281
2026-01-28 17:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2026-01-28 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7836ce4-1230-5398-9762-87ddca840239 with identifier: EN30281
2026-01-28 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2026-01-28 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e7836ce4-1230-5398-9762-87ddca840239 spider: auto1.es
2026-01-28 17:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e7836ce4-1230-5398-9762-87ddca840239 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:42:31Z',
 'fuel_type': 'electro',
 'id': 'e7836ce4-1230-5398-9762-87ddca840239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN30281',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 31440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito lang',
 'transmission': 'automatic',
 'trim': 'e lang',
 'year': 2022}
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN30281%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [auto1.es] INFO: Saving data for EN30281: {'auction_closing_time': 1769704951.0, 'created_time': 1768237586.69156, 'last_price_update_time': 1769619881.351635}
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN30281') HTTP/1.1" 204 0
2026-01-28 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG92427> (referer: https://www.auto1.com/v1/car-details-view/XG92427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW83541> (referer: https://www.auto1.com/v1/car-details-view/YW83541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB61251> (referer: https://www.auto1.com/v1/car-details-view/FB61251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08c74d92-e668-5ac1-90ea-98cc9f4552dc with identifier: KN94003
2026-01-28 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc with scrape type 1
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_096a1a4e96c7c27f065e650cb629c501.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_096a1a4e96c7c27f065e650cb629c501.jpg not downloaded yet
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg not downloaded yet
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg not downloaded yet
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg not downloaded yet
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_29c58761309d96d276b216ec98d45c71.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_29c58761309d96d276b216ec98d45c71.jpg not downloaded yet
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg not downloaded yet
2026-01-28 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b685c697-3e90-56fa-a62b-3f370d473be6 with identifier: XG92427
2026-01-28 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b685c697-3e90-56fa-a62b-3f370d473be6 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b685c697-3e90-56fa-a62b-3f370d473be6 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b685c697-3e90-56fa-a62b-3f370d473be6, identifier: XG92427
2026-01-28 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f24547b4-54d2-55e6-b3f5-18ad083a2873 with identifier: YW83541
2026-01-28 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f24547b4-54d2-55e6-b3f5-18ad083a2873 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f24547b4-54d2-55e6-b3f5-18ad083a2873 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f24547b4-54d2-55e6-b3f5-18ad083a2873, identifier: YW83541
2026-01-28 17:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2460d377-59ee-526d-8122-6fe137a853a5 with identifier: FB61251
2026-01-28 17:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2460d377-59ee-526d-8122-6fe137a853a5 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2460d377-59ee-526d-8122-6fe137a853a5 with scrape type 2
2026-01-28 17:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2460d377-59ee-526d-8122-6fe137a853a5, identifier: FB61251
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg not downloaded yet
2026-01-28 17:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b685c697-3e90-56fa-a62b-3f370d473be6 with identifier: XG92427
2026-01-28 17:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b685c697-3e90-56fa-a62b-3f370d473be6 with identifier: XG92427
2026-01-28 17:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b685c697-3e90-56fa-a62b-3f370d473be6 with identifier: XG92427 to the API
2026-01-28 17:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XG92427>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:15:35Z',
 'fuel_type': 'diesel',
 'id': 'b685c697-3e90-56fa-a62b-3f370d473be6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG92427',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 100037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Tecno Sky 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno Sky 2WD',
 'year': 2022}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG92427%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [auto1.es] INFO: Saving data for XG92427: {'auction_closing_time': 1769703335.0, 'created_time': 1768410367.25978, 'last_price_update_time': 1769619882.118184}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG92427') HTTP/1.1" 204 0
2026-01-28 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f24547b4-54d2-55e6-b3f5-18ad083a2873 with identifier: YW83541
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f24547b4-54d2-55e6-b3f5-18ad083a2873 with identifier: YW83541
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f24547b4-54d2-55e6-b3f5-18ad083a2873 spider: auto1.es
2026-01-28 17:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f24547b4-54d2-55e6-b3f5-18ad083a2873 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:43:15Z',
 'fuel_type': 'diesel',
 'id': 'f24547b4-54d2-55e6-b3f5-18ad083a2873',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW83541',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 67614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2022}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YW83541%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [auto1.es] INFO: Saving data for YW83541: {'auction_closing_time': 1769704995.0, 'created_time': 1769101526.899668, 'last_price_update_time': 1769619882.341089}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YW83541') HTTP/1.1" 204 0
2026-01-28 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2460d377-59ee-526d-8122-6fe137a853a5 with identifier: FB61251
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2460d377-59ee-526d-8122-6fe137a853a5 with identifier: FB61251
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 90465, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fb61251', 'expiration_date': '2026-01-29t16:21:51z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2460d377-59ee-526d-8122-6fe137a853a5', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 90465}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:21:51z',
     'fuel_type': 'electro',
     'id': '2460d377-59ee-526d-8122-6fe137a853a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fb61251',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 90465,
     'odometer_in_km': 90465,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-13',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 2460d377-59ee-526d-8122-6fe137a853a5 spider: auto1.es
2026-01-28 17:04:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2460d377-59ee-526d-8122-6fe137a853a5 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 90465, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-13', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fb61251', 'expiration_date': '2026-01-29t16:21:51z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '2460d377-59ee-526d-8122-6fe137a853a5', 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 90465}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:21:51z',
     'fuel_type': 'electro',
     'id': '2460d377-59ee-526d-8122-6fe137a853a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fb61251',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 90465,
     'odometer_in_km': 90465,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-13',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:21:51Z',
 'fuel_type': 'electro',
 'id': '2460d377-59ee-526d-8122-6fe137a853a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB61251',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 90465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB61251%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [auto1.es] INFO: Saving data for FB61251: {'auction_closing_time': 1769703711.0, 'created_time': 1769101526.574874, 'last_price_update_time': 1769619882.562338}
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FB61251') HTTP/1.1" 204 0
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg not downloaded yet
2026-01-28 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ42826/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV60127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV19691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT76222> (referer: https://www.auto1.com/v1/car-details-view/CT76222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_319b14c84020fb639aa3d94be71be535.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_319b14c84020fb639aa3d94be71be535.jpg not downloaded yet
2026-01-28 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg not downloaded yet
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg not downloaded yet
2026-01-28 17:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7676d667-fc24-5b48-be60-278d800bca32 with identifier: CT76222
2026-01-28 17:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7676d667-fc24-5b48-be60-278d800bca32 with scrape type 2
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7676d667-fc24-5b48-be60-278d800bca32 with scrape type 2
2026-01-28 17:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7676d667-fc24-5b48-be60-278d800bca32, identifier: CT76222
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg not downloaded yet
2026-01-28 17:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7676d667-fc24-5b48-be60-278d800bca32 with identifier: CT76222
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7676d667-fc24-5b48-be60-278d800bca32 with identifier: CT76222
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2026-01-28 17:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7676d667-fc24-5b48-be60-278d800bca32 spider: auto1.es
2026-01-28 17:04:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7676d667-fc24-5b48-be60-278d800bca32 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:03:55Z',
 'fuel_type': 'diesel',
 'id': '7676d667-fc24-5b48-be60-278d800bca32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT76222',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 160061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-28',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2022}
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT76222%27 HTTP/1.1" 200 None
2026-01-28 17:04:43 [auto1.es] INFO: Saving data for CT76222: {'auction_closing_time': 1769702635.0, 'created_time': 1769447325.69579, 'last_price_update_time': 1769619883.099818}
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT76222') HTTP/1.1" 204 0
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_85e62eb818e287f331b7076c2bfa0f08.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_85e62eb818e287f331b7076c2bfa0f08.jpg not downloaded yet
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_29c58761309d96d276b216ec98d45c71.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_1a2aa716408b5f4ec024a66146af85c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_1a2aa716408b5f4ec024a66146af85c9.jpg not downloaded yet
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg not downloaded yet
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL27489/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_0f70847febf77732dfab1897caf237cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_0f70847febf77732dfab1897caf237cd.jpg not downloaded yet
2026-01-28 17:04:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62961ed0>
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg saved to cache
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f6890>
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg saved to cache
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b69471e50>
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg saved to cache
2026-01-28 17:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62667250>
2026-01-28 17:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_29c58761309d96d276b216ec98d45c71.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_29c58761309d96d276b216ec98d45c71.jpg saved to cache
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_1a2aa716408b5f4ec024a66146af85c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_0f70847febf77732dfab1897caf237cd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY15229> (referer: https://www.auto1.com/v1/car-details-view/RY15229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA90839> (referer: https://www.auto1.com/v1/car-details-view/NA90839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL11886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH92259> (referer: https://www.auto1.com/v1/car-details-view/FH92259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS18952/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346a490>
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg saved to cache
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f5250>
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg saved to cache
2026-01-28 17:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP03049> (referer: https://www.auto1.com/v1/car-details-view/LP03049/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e3c50>
2026-01-28 17:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_1a2aa716408b5f4ec024a66146af85c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_1a2aa716408b5f4ec024a66146af85c9.jpg saved to cache
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6834b0d0>
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_0f70847febf77732dfab1897caf237cd.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_0f70847febf77732dfab1897caf237cd.jpg saved to cache
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-01-28 17:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742e8cc1-1519-59f7-a54d-33c70fd4da45 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742e8cc1-1519-59f7-a54d-33c70fd4da45 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 742e8cc1-1519-59f7-a54d-33c70fd4da45, identifier: RY15229
2026-01-28 17:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2026-01-28 17:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b946ccd5-b005-5ad9-a42c-1fb341750b65 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b946ccd5-b005-5ad9-a42c-1fb341750b65 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b946ccd5-b005-5ad9-a42c-1fb341750b65, identifier: NA90839
2026-01-28 17:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-01-28 17:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be16b84b-b737-53f4-8bc0-6f80a60fb849 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be16b84b-b737-53f4-8bc0-6f80a60fb849 with scrape type 2
2026-01-28 17:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: be16b84b-b737-53f4-8bc0-6f80a60fb849, identifier: FH92259
2026-01-28 17:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-01-28 17:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229
2026-01-28 17:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 742e8cc1-1519-59f7-a54d-33c70fd4da45 with identifier: RY15229 to the API
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY15229>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:03:17Z',
 'fuel_type': 'diesel',
 'id': '742e8cc1-1519-59f7-a54d-33c70fd4da45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY15229',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '1er',
 'odometer': 106179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY15229%27 HTTP/1.1" 200 None
2026-01-28 17:04:45 [auto1.es] INFO: Saving data for RY15229: {'auction_closing_time': 1769702597.0, 'created_time': 1768410297.678637, 'last_price_update_time': 1769619885.879559}
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY15229') HTTP/1.1" 204 0
2026-01-28 17:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2026-01-28 17:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b946ccd5-b005-5ad9-a42c-1fb341750b65 with identifier: NA90839
2026-01-28 17:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
2026-01-28 17:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b946ccd5-b005-5ad9-a42c-1fb341750b65 spider: auto1.es
2026-01-28 17:04:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b946ccd5-b005-5ad9-a42c-1fb341750b65 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:55:08Z',
 'fuel_type': 'electro',
 'id': 'b946ccd5-b005-5ad9-a42c-1fb341750b65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA90839',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 66979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito eVito extralang',
 'transmission': 'automatic',
 'trim': 'e extralang',
 'year': 2020}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA90839%27 HTTP/1.1" 200 None
2026-01-28 17:04:46 [auto1.es] INFO: Saving data for NA90839: {'auction_closing_time': 1769705708.0, 'created_time': 1768237353.448677, 'last_price_update_time': 1769619886.11456}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA90839') HTTP/1.1" 204 0
2026-01-28 17:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-01-28 17:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259
2026-01-28 17:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: be16b84b-b737-53f4-8bc0-6f80a60fb849 with identifier: FH92259 to the API
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FH92259>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 211,
 'expiration_date': '2026-01-29T16:09:57Z',
 'fuel_type': 'hybrid',
 'id': 'be16b84b-b737-53f4-8bc0-6f80a60fb849',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH92259',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 28152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Plus Bright 2WD',
 'transmission': 'automatic',
 'trim': 'Plus Bright 2WD',
 'year': 2023}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH92259%27 HTTP/1.1" 200 None
2026-01-28 17:04:46 [auto1.es] INFO: Saving data for FH92259: {'auction_closing_time': 1769702997.0, 'created_time': 1768410188.214444, 'last_price_update_time': 1769619886.436875}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FH92259') HTTP/1.1" 204 0
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_85e62eb818e287f331b7076c2bfa0f08.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_319b14c84020fb639aa3d94be71be535.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT08561> (referer: https://www.auto1.com/v1/car-details-view/YT08561/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY63222> (referer: https://www.auto1.com/v1/car-details-view/NY63222/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 868fcaa1-bee4-5670-8d28-63ef142dc035 with identifier: LP03049
2026-01-28 17:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 868fcaa1-bee4-5670-8d28-63ef142dc035 with scrape type 2
2026-01-28 17:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 868fcaa1-bee4-5670-8d28-63ef142dc035 with scrape type 2
2026-01-28 17:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 868fcaa1-bee4-5670-8d28-63ef142dc035, identifier: LP03049
2026-01-28 17:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 868fcaa1-bee4-5670-8d28-63ef142dc035 with identifier: LP03049
2026-01-28 17:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 868fcaa1-bee4-5670-8d28-63ef142dc035 with identifier: LP03049
2026-01-28 17:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 868fcaa1-bee4-5670-8d28-63ef142dc035 with identifier: LP03049 to the API
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP03049>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 211,
 'expiration_date': '2026-01-29T16:53:48Z',
 'fuel_type': 'hybrid',
 'id': '868fcaa1-bee4-5670-8d28-63ef142dc035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP03049',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 67103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T4 Recharge Plug-in Hybrid Plus Bright 2WD',
 'transmission': 'automatic',
 'trim': 'Plus Bright 2WD',
 'year': 2023}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP03049%27 HTTP/1.1" 200 None
2026-01-28 17:04:46 [auto1.es] INFO: Saving data for LP03049: {'auction_closing_time': 1769705628.0, 'created_time': 1768410302.653651, 'last_price_update_time': 1769619886.877578}
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP03049') HTTP/1.1" 204 0
2026-01-28 17:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aed350>
2026-01-28 17:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_85e62eb818e287f331b7076c2bfa0f08.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_85e62eb818e287f331b7076c2bfa0f08.jpg saved to cache
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628e6ed0>
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg saved to cache
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291ad50>
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg saved to cache
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289ff10>
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg saved to cache
2026-01-28 17:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6276d390>
2026-01-28 17:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_319b14c84020fb639aa3d94be71be535.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_319b14c84020fb639aa3d94be71be535.jpg saved to cache
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341bed0>
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg saved to cache
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2026-01-28 17:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c96392-ea24-5330-8a9a-670364abdbf0 with scrape type 2
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c96392-ea24-5330-8a9a-670364abdbf0 with scrape type 2
2026-01-28 17:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f8c96392-ea24-5330-8a9a-670364abdbf0, identifier: YT08561
2026-01-28 17:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7864e58-e914-5385-96cc-bb8daba0df9a with identifier: NY63222
2026-01-28 17:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7864e58-e914-5385-96cc-bb8daba0df9a with scrape type 1
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg not downloaded yet
2026-01-28 17:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2026-01-28 17:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561
2026-01-28 17:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f8c96392-ea24-5330-8a9a-670364abdbf0 with identifier: YT08561 to the API
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT08561>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:23:03Z',
 'fuel_type': 'diesel',
 'id': 'f8c96392-ea24-5330-8a9a-670364abdbf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT08561',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 97593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YT08561%27 HTTP/1.1" 200 None
2026-01-28 17:04:48 [auto1.es] INFO: Saving data for YT08561: {'auction_closing_time': 1769703783.0, 'created_time': 1767962367.427681, 'last_price_update_time': 1769619888.973985}
2026-01-28 17:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YT08561') HTTP/1.1" 204 0
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg not downloaded yet
2026-01-28 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX84601/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ42826> (referer: https://www.auto1.com/v1/car-details-view/LJ42826/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB84696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV19691> (referer: https://www.auto1.com/v1/car-details-view/ZV19691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV60127> (referer: https://www.auto1.com/v1/car-details-view/VV60127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_8a757d5769f6deef654bd5bc77e55a05.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_8a757d5769f6deef654bd5bc77e55a05.jpg not downloaded yet
2026-01-28 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63474910>
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg saved to cache
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_018d3216391289f8786f4a1bd881e7f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_018d3216391289f8786f4a1bd881e7f1.jpg not downloaded yet
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_1a2da31386ca212c27033420b41fe6a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_1a2da31386ca212c27033420b41fe6a5.jpg not downloaded yet
2026-01-28 17:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae6bde34-d1e5-566c-8653-b0c134bbfb8e with identifier: LJ42826
2026-01-28 17:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae6bde34-d1e5-566c-8653-b0c134bbfb8e with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae6bde34-d1e5-566c-8653-b0c134bbfb8e with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae6bde34-d1e5-566c-8653-b0c134bbfb8e, identifier: LJ42826
2026-01-28 17:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2026-01-28 17:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c, identifier: ZV19691
2026-01-28 17:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-01-28 17:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af320b28-95ce-51db-b6ff-190c132fd8e2 with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af320b28-95ce-51db-b6ff-190c132fd8e2 with scrape type 2
2026-01-28 17:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af320b28-95ce-51db-b6ff-190c132fd8e2, identifier: VV60127
2026-01-28 17:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae6bde34-d1e5-566c-8653-b0c134bbfb8e with identifier: LJ42826
2026-01-28 17:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae6bde34-d1e5-566c-8653-b0c134bbfb8e with identifier: LJ42826
2026-01-28 17:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ae6bde34-d1e5-566c-8653-b0c134bbfb8e with identifier: LJ42826 to the API
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LJ42826>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:54:18Z',
 'fuel_type': 'diesel',
 'id': 'ae6bde34-d1e5-566c-8653-b0c134bbfb8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ42826',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 141984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI advanced',
 'transmission': 'manual',
 'trim': 'advanced',
 'year': 2022}
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LJ42826%27 HTTP/1.1" 200 None
2026-01-28 17:04:49 [auto1.es] INFO: Saving data for LJ42826: {'auction_closing_time': 1769705658.0, 'created_time': 1769148156.795221, 'last_price_update_time': 1769619889.97201}
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LJ42826') HTTP/1.1" 204 0
2026-01-28 17:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2026-01-28 17:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691
2026-01-28 17:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e7f3d1e-d7f6-5667-a078-5c05b74ca88c with identifier: ZV19691 to the API
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV19691>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:04:19Z',
 'fuel_type': 'petrol',
 'id': '8e7f3d1e-d7f6-5667-a078-5c05b74ca88c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV19691',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 147473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZV19691%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [auto1.es] INFO: Saving data for ZV19691: {'auction_closing_time': 1769702659.0, 'created_time': 1768237349.715571, 'last_price_update_time': 1769619890.386919}
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZV19691') HTTP/1.1" 204 0
2026-01-28 17:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-01-28 17:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127
2026-01-28 17:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: af320b28-95ce-51db-b6ff-190c132fd8e2 with identifier: VV60127 to the API
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV60127>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:08:00Z',
 'fuel_type': 'diesel',
 'id': 'af320b28-95ce-51db-b6ff-190c132fd8e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV60127',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 73343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VV60127%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [auto1.es] INFO: Saving data for VV60127: {'auction_closing_time': 1769702880.0, 'created_time': 1768410465.699247, 'last_price_update_time': 1769619890.702773}
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VV60127') HTTP/1.1" 204 0
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg not downloaded yet
2026-01-28 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR92876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_f2ea133995b637119fc7de5442daf5a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f2ea133995b637119fc7de5442daf5a5.jpg not downloaded yet
2026-01-28 17:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS18952> (referer: https://www.auto1.com/v1/car-details-view/TS18952/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg not downloaded yet
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg not downloaded yet
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_e1098bbddac89616048fb548f936b8a1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e1098bbddac89616048fb548f936b8a1.jpg not downloaded yet
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_053f91d17277d1929c8e4ca331633eb3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_053f91d17277d1929c8e4ca331633eb3.jpg not downloaded yet
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_e395b53ff4f46c18315c5abab9837633.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e395b53ff4f46c18315c5abab9837633.jpg not downloaded yet
2026-01-28 17:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627020d0>
2026-01-28 17:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg saved to cache
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62695590>
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg saved to cache
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_1a2da31386ca212c27033420b41fe6a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_0fb9329dc21355047f95722a218f8d5f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_0fb9329dc21355047f95722a218f8d5f.jpg not downloaded yet
2026-01-28 17:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-01-28 17:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60543c97-6116-5eeb-b75d-a5fbe33196de with scrape type 2
2026-01-28 17:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60543c97-6116-5eeb-b75d-a5fbe33196de, identifier: TS18952
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_2287afdb7d23161e46e96c0dc669ece5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_2287afdb7d23161e46e96c0dc669ece5.jpg not downloaded yet
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU04753/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR99640/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB81076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC26234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-01-28 17:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952
2026-01-28 17:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60543c97-6116-5eeb-b75d-a5fbe33196de with identifier: TS18952 to the API
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS18952>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:07:10Z',
 'fuel_type': 'diesel',
 'id': '60543c97-6116-5eeb-b75d-a5fbe33196de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS18952',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 108027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi GT Pack',
 'transmission': 'manual',
 'trim': 'GT Pack',
 'year': 2021}
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS18952%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [auto1.es] INFO: Saving data for TS18952: {'auction_closing_time': 1769702830.0, 'created_time': 1768237344.145724, 'last_price_update_time': 1769619892.015997}
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS18952') HTTP/1.1" 204 0
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_ad1cabacab4be25226b6be4e87aff89b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_ad1cabacab4be25226b6be4e87aff89b.jpg not downloaded yet
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL11886> (referer: https://www.auto1.com/v1/car-details-view/YL11886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62657690>
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_1a2da31386ca212c27033420b41fe6a5.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_1a2da31386ca212c27033420b41fe6a5.jpg saved to cache
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL27489> (referer: https://www.auto1.com/v1/car-details-view/ZL27489/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_0fb9329dc21355047f95722a218f8d5f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_219beff63f115fdc9f12eb652e164d4b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_219beff63f115fdc9f12eb652e164d4b.jpg not downloaded yet
2026-01-28 17:04:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6299ef90>
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg saved to cache
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e1098bbddac89616048fb548f936b8a1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_053f91d17277d1929c8e4ca331633eb3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e395b53ff4f46c18315c5abab9837633.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a93e9c21-ebd2-519f-9902-25c9ce16de35 with identifier: YL11886
2026-01-28 17:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a93e9c21-ebd2-519f-9902-25c9ce16de35 with scrape type 1
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item a93e9c21-ebd2-519f-9902-25c9ce16de35
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_e36a7a16b7682189286a5174cbd880bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e36a7a16b7682189286a5174cbd880bd.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_e653cea258510efd17c6d474ffdc6787.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e653cea258510efd17c6d474ffdc6787.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_cf70dc578941a7a784718c4097f0ac33.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_cf70dc578941a7a784718c4097f0ac33.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_841d39776b40fef4bfa014d74cd83fdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_841d39776b40fef4bfa014d74cd83fdd.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_6ecf9ce9d0d70fe8ccbe450d92ce915a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_6ecf9ce9d0d70fe8ccbe450d92ce915a.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_5bb74411a2c08abeb1a83f0a33219fb6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_5bb74411a2c08abeb1a83f0a33219fb6.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_3d99cb9e41568400de5366b87cdadbe3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_3d99cb9e41568400de5366b87cdadbe3.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_460cecd79eb8ebbc4159e13e6086b268.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_460cecd79eb8ebbc4159e13e6086b268.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_7a0a3805a2d35ea56e4e9fe903c8a4bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_7a0a3805a2d35ea56e4e9fe903c8a4bd.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_ca4fb4e7c99f0d26a5730c8fbcdeea91.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_ca4fb4e7c99f0d26a5730c8fbcdeea91.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_e222aea930dc0cd8033ca06a08cb1600.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e222aea930dc0cd8033ca06a08cb1600.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_bce428ba3dfc41ceaef96747587eaaf9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_bce428ba3dfc41ceaef96747587eaaf9.jpg already downloaded
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252Faf%252Fabafd8edfc3800a02840e4e55dfd7173%252Fpa%252FYL11886_0af24b1df7c2aeaf96d4580935ecc28a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_0af24b1df7c2aeaf96d4580935ecc28a.jpg already downloaded
2026-01-28 17:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a93e9c21-ebd2-519f-9902-25c9ce16de35, identifier: YL11886
2026-01-28 17:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2026-01-28 17:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e471e58e-1f9d-56de-9892-98d8b440cbd1 with scrape type 2
2026-01-28 17:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e471e58e-1f9d-56de-9892-98d8b440cbd1 with scrape type 2
2026-01-28 17:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e471e58e-1f9d-56de-9892-98d8b440cbd1, identifier: ZL27489
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260c710>
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_0fb9329dc21355047f95722a218f8d5f.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_0fb9329dc21355047f95722a218f8d5f.jpg saved to cache
2026-01-28 17:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a93e9c21-ebd2-519f-9902-25c9ce16de35 with identifier: YL11886
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a93e9c21-ebd2-519f-9902-25c9ce16de35 with identifier: YL11886
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a93e9c21-ebd2-519f-9902-25c9ce16de35 spider: auto1.es
2026-01-28 17:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a93e9c21-ebd2-519f-9902-25c9ce16de35 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:02:05Z',
 'fuel_type': 'diesel',
 'id': 'a93e9c21-ebd2-519f-9902-25c9ce16de35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL11886',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 71561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e36a7a16b7682189286a5174cbd880bd.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e653cea258510efd17c6d474ffdc6787.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_cf70dc578941a7a784718c4097f0ac33.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_841d39776b40fef4bfa014d74cd83fdd.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_6ecf9ce9d0d70fe8ccbe450d92ce915a.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_5bb74411a2c08abeb1a83f0a33219fb6.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_3d99cb9e41568400de5366b87cdadbe3.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_460cecd79eb8ebbc4159e13e6086b268.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_7a0a3805a2d35ea56e4e9fe903c8a4bd.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_ca4fb4e7c99f0d26a5730c8fbcdeea91.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e222aea930dc0cd8033ca06a08cb1600.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_bce428ba3dfc41ceaef96747587eaaf9.jpg',
                'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_0af24b1df7c2aeaf96d4580935ecc28a.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32847,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e36a7a16b7682189286a5174cbd880bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32847,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e653cea258510efd17c6d474ffdc6787.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33017,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_cf70dc578941a7a784718c4097f0ac33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33017,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_841d39776b40fef4bfa014d74cd83fdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35858,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_6ecf9ce9d0d70fe8ccbe450d92ce915a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32593,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_5bb74411a2c08abeb1a83f0a33219fb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32372,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_3d99cb9e41568400de5366b87cdadbe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32593,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_460cecd79eb8ebbc4159e13e6086b268.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59036,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_7a0a3805a2d35ea56e4e9fe903c8a4bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47714,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_ca4fb4e7c99f0d26a5730c8fbcdeea91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47645,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_e222aea930dc0cd8033ca06a08cb1600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13086,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_bce428ba3dfc41ceaef96747587eaaf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93e9c21-ebd2-519f-9902-25c9ce16de35/a93e9c21-ebd2-519f-9902-25c9ce16de35_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13086,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/af/abafd8edfc3800a02840e4e55dfd7173/pa/YL11886_0af24b1df7c2aeaf96d4580935ecc28a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YL11886%27 HTTP/1.1" 200 None
2026-01-28 17:04:53 [auto1.es] INFO: Saving data for YL11886: {'created_time': 1769619893.51575, 'last_price_update_time': 1769619893.515761, 'auction_closing_time': 1769702525.0}
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YL11886') HTTP/1.1" 204 0
2026-01-28 17:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e471e58e-1f9d-56de-9892-98d8b440cbd1 with identifier: ZL27489
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e471e58e-1f9d-56de-9892-98d8b440cbd1 spider: auto1.es
2026-01-28 17:04:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e471e58e-1f9d-56de-9892-98d8b440cbd1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:57:01Z',
 'fuel_type': 'electro',
 'id': 'e471e58e-1f9d-56de-9892-98d8b440cbd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL27489',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 31048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-18',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit electric drive 135 kW L3 Trend',
 'transmission': 'automatic',
 'trim': 'L3 Trend',
 'year': 2022}
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL27489%27 HTTP/1.1" 200 None
2026-01-28 17:04:54 [auto1.es] INFO: Saving data for ZL27489: {'auction_closing_time': 1769705821.0, 'created_time': 1768237735.343786, 'last_price_update_time': 1769619894.212926}
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL27489') HTTP/1.1" 204 0
2026-01-28 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_ad1cabacab4be25226b6be4e87aff89b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_2287afdb7d23161e46e96c0dc669ece5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW47045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW59429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d1390>
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_e1098bbddac89616048fb548f936b8a1.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e1098bbddac89616048fb548f936b8a1.jpg saved to cache
2026-01-28 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a9e050>
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg saved to cache
2026-01-28 17:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626971d0>
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_053f91d17277d1929c8e4ca331633eb3.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_053f91d17277d1929c8e4ca331633eb3.jpg saved to cache
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a07390>
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_e395b53ff4f46c18315c5abab9837633.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e395b53ff4f46c18315c5abab9837633.jpg saved to cache
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS38549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW01202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU98177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR92876> (referer: https://www.auto1.com/v1/car-details-view/YR92876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX84601> (referer: https://www.auto1.com/v1/car-details-view/KX84601/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB84696> (referer: https://www.auto1.com/v1/car-details-view/WB84696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6345a090>
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_ad1cabacab4be25226b6be4e87aff89b.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_ad1cabacab4be25226b6be4e87aff89b.jpg saved to cache
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a0d450>
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_2287afdb7d23161e46e96c0dc669ece5.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_2287afdb7d23161e46e96c0dc669ece5.jpg saved to cache
2026-01-28 17:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63503a90>
2026-01-28 17:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg saved to cache
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f2ea133995b637119fc7de5442daf5a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_219beff63f115fdc9f12eb652e164d4b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_018d3216391289f8786f4a1bd881e7f1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_8a757d5769f6deef654bd5bc77e55a05.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f69bc6-1c21-5076-97f5-441dffd356b0 with identifier: YR92876
2026-01-28 17:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f69bc6-1c21-5076-97f5-441dffd356b0 with scrape type 2
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f69bc6-1c21-5076-97f5-441dffd356b0 with scrape type 2
2026-01-28 17:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7f69bc6-1c21-5076-97f5-441dffd356b0, identifier: YR92876
2026-01-28 17:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 with identifier: KX84601
2026-01-28 17:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 with scrape type 1
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_fd847d8201a8fac971d3358b3f92ff2c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_fd847d8201a8fac971d3358b3f92ff2c.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_45588b31aac261b55ca60d1a25828cfd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_45588b31aac261b55ca60d1a25828cfd.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_b9d2787113c8c422f97af233c3417d72.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b9d2787113c8c422f97af233c3417d72.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_0cf4238c43be988fd3f4a5233c3c1936.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_0cf4238c43be988fd3f4a5233c3c1936.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_9fbe16aa71b7a4522e3c3f23d3b9138c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_9fbe16aa71b7a4522e3c3f23d3b9138c.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_25595d0b7e4530a62b0ee1e46dbdd0f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_25595d0b7e4530a62b0ee1e46dbdd0f5.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_a5c23a041ea3e46995694ed716fe2f35.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_a5c23a041ea3e46995694ed716fe2f35.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_ec11b811cce083b0d09375826bad0b42.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_ec11b811cce083b0d09375826bad0b42.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_4c27d1810d05bf795ce5ea67f21cbcb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_4c27d1810d05bf795ce5ea67f21cbcb4.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_cb505f4b6066790a3626c287d3406346.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_cb505f4b6066790a3626c287d3406346.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_d6c50a41708b0d4f95e09ac36477cdf3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_d6c50a41708b0d4f95e09ac36477cdf3.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_16a1fddcfa65b68d6e2f254fbfdd3a77.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_16a1fddcfa65b68d6e2f254fbfdd3a77.jpg already downloaded
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fe7%252Fcfe7a587cef3b0b8c1bc5795637d6aec%252Fpa%252FKX84601_b049db27306680dbd19d4674319f4fa3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b049db27306680dbd19d4674319f4fa3.jpg already downloaded
2026-01-28 17:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1, identifier: KX84601
2026-01-28 17:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 with identifier: WB84696
2026-01-28 17:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 with scrape type 2
2026-01-28 17:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 with scrape type 2
2026-01-28 17:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8, identifier: WB84696
2026-01-28 17:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7f69bc6-1c21-5076-97f5-441dffd356b0 with identifier: YR92876
2026-01-28 17:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7f69bc6-1c21-5076-97f5-441dffd356b0 with identifier: YR92876
2026-01-28 17:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7f69bc6-1c21-5076-97f5-441dffd356b0 with identifier: YR92876 to the API
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YR92876>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:13:22Z',
 'fuel_type': 'diesel',
 'id': 'b7f69bc6-1c21-5076-97f5-441dffd356b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR92876',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 100813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YR92876%27 HTTP/1.1" 200 None
2026-01-28 17:04:56 [auto1.es] INFO: Saving data for YR92876: {'auction_closing_time': 1769703202.0, 'created_time': 1768237338.084322, 'last_price_update_time': 1769619896.995363}
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YR92876') HTTP/1.1" 204 0
2026-01-28 17:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 with identifier: KX84601
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 with identifier: KX84601
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 spider: auto1.es
2026-01-28 17:04:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:18:16Z',
 'fuel_type': 'diesel',
 'id': 'cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX84601',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 70704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_fd847d8201a8fac971d3358b3f92ff2c.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_45588b31aac261b55ca60d1a25828cfd.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b9d2787113c8c422f97af233c3417d72.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_0cf4238c43be988fd3f4a5233c3c1936.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_9fbe16aa71b7a4522e3c3f23d3b9138c.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_25595d0b7e4530a62b0ee1e46dbdd0f5.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_a5c23a041ea3e46995694ed716fe2f35.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_ec11b811cce083b0d09375826bad0b42.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_4c27d1810d05bf795ce5ea67f21cbcb4.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_cb505f4b6066790a3626c287d3406346.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_d6c50a41708b0d4f95e09ac36477cdf3.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_16a1fddcfa65b68d6e2f254fbfdd3a77.jpg',
                'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b049db27306680dbd19d4674319f4fa3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36769,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_fd847d8201a8fac971d3358b3f92ff2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36531,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_45588b31aac261b55ca60d1a25828cfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32274,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b9d2787113c8c422f97af233c3417d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32157,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_0cf4238c43be988fd3f4a5233c3c1936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36155,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_9fbe16aa71b7a4522e3c3f23d3b9138c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37555,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_25595d0b7e4530a62b0ee1e46dbdd0f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37407,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_a5c23a041ea3e46995694ed716fe2f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37555,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_ec11b811cce083b0d09375826bad0b42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56231,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_4c27d1810d05bf795ce5ea67f21cbcb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61966,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_cb505f4b6066790a3626c287d3406346.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62173,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_d6c50a41708b0d4f95e09ac36477cdf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 13034,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_16a1fddcfa65b68d6e2f254fbfdd3a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1/cefb488f-a9ec-5b7d-ae78-7a5bb51dbba1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 16048,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/e7/cfe7a587cef3b0b8c1bc5795637d6aec/pa/KX84601_b049db27306680dbd19d4674319f4fa3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-12',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX84601%27 HTTP/1.1" 200 None
2026-01-28 17:04:57 [auto1.es] INFO: Saving data for KX84601: {'created_time': 1769619897.211883, 'last_price_update_time': 1769619897.211893, 'auction_closing_time': 1769703496.0}
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX84601') HTTP/1.1" 204 0
2026-01-28 17:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 with identifier: WB84696
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 with identifier: WB84696
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 spider: auto1.es
2026-01-28 17:04:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 61e856ad-e994-5d2d-b54a-7d9f4672bdb8 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:55:58Z',
 'fuel_type': 'diesel',
 'id': '61e856ad-e994-5d2d-b54a-7d9f4672bdb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB84696',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 125072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WB84696%27 HTTP/1.1" 200 None
2026-01-28 17:04:57 [auto1.es] INFO: Saving data for WB84696: {'auction_closing_time': 1769705758.0, 'created_time': 1769014843.843443, 'last_price_update_time': 1769619897.437913}
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WB84696') HTTP/1.1" 204 0
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62774490>
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_f2ea133995b637119fc7de5442daf5a5.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f2ea133995b637119fc7de5442daf5a5.jpg saved to cache
2026-01-28 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636d3950>
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_219beff63f115fdc9f12eb652e164d4b.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_219beff63f115fdc9f12eb652e164d4b.jpg saved to cache
2026-01-28 17:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a62550>
2026-01-28 17:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: Resetting dropped connection: alxproduction.blob.core.windows.net
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_018d3216391289f8786f4a1bd881e7f1.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_018d3216391289f8786f4a1bd881e7f1.jpg saved to cache
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365ead0>
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252Fb0%252F71b0afe302d3e6bfc1bdb25f84e96c8b%252Fpa%252FNY63222_8a757d5769f6deef654bd5bc77e55a05.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_8a757d5769f6deef654bd5bc77e55a05.jpg saved to cache
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7864e58-e914-5385-96cc-bb8daba0df9a
2026-01-28 17:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7864e58-e914-5385-96cc-bb8daba0df9a, skipping ID generation
2026-01-28 17:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7864e58-e914-5385-96cc-bb8daba0df9a with scrape type 1
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7864e58-e914-5385-96cc-bb8daba0df9a from tracking dictionaries
2026-01-28 17:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7864e58-e914-5385-96cc-bb8daba0df9a sending to next pipeline
2026-01-28 17:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a7864e58-e914-5385-96cc-bb8daba0df9a, identifier: NY63222
2026-01-28 17:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a7864e58-e914-5385-96cc-bb8daba0df9a with identifier: NY63222
2026-01-28 17:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a7864e58-e914-5385-96cc-bb8daba0df9a with identifier: NY63222
2026-01-28 17:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a7864e58-e914-5385-96cc-bb8daba0df9a with identifier: NY63222 to the API
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_8a757d5769f6deef654bd5bc77e55a05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:42:20Z',
 'fuel_type': 'petrol',
 'id': 'a7864e58-e914-5385-96cc-bb8daba0df9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY63222',
 'listing': 'auction',
 'location': 'ES, Alcalá de Guadaíra',
 'make': 'DR',
 'model': 'DR 4.0',
 'odometer': 54487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_122b4442e8d79f9f02d9b8c75dc89dd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_4e0f77a99e14f96df86b565e74ac3aa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_8a757d5769f6deef654bd5bc77e55a05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_018d3216391289f8786f4a1bd881e7f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_1a2da31386ca212c27033420b41fe6a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_09d8ea74fac6d57c4b009c4df78f80dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f2ea133995b637119fc7de5442daf5a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_75fb1bc8c53a2cdc3c1bac48300af00a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_f31ad2894cf53d97d329d0bd7970b7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e1098bbddac89616048fb548f936b8a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_053f91d17277d1929c8e4ca331633eb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_e395b53ff4f46c18315c5abab9837633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_0fb9329dc21355047f95722a218f8d5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_2287afdb7d23161e46e96c0dc669ece5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_ad1cabacab4be25226b6be4e87aff89b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7864e58-e914-5385-96cc-bb8daba0df9a/a7864e58-e914-5385-96cc-bb8daba0df9a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/b0/71b0afe302d3e6bfc1bdb25f84e96c8b/pa/NY63222_219beff63f115fdc9f12eb652e164d4b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DR DR 4.0 1.5',
 'transmission': 'manual',
 'trim': '',
 'year': 2023}
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NY63222%27 HTTP/1.1" 200 None
2026-01-28 17:04:58 [auto1.es] INFO: Saving data for NY63222: {'created_time': 1769619898.88107, 'last_price_update_time': 1769619898.881081, 'auction_closing_time': 1769704940.0}
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NY63222') HTTP/1.1" 204 0
2026-01-28 17:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_096a1a4e96c7c27f065e650cb629c501.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC26234> (referer: https://www.auto1.com/v1/car-details-view/YC26234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:04:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272a9d0>
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F5e%252F565e08d93dcf7da7ef35a3945f8e6b9e%252Fpa%252FKN94003_096a1a4e96c7c27f065e650cb629c501.jpg') HTTP/1.1" 204 0
2026-01-28 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_096a1a4e96c7c27f065e650cb629c501.jpg saved to cache
2026-01-28 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc
2026-01-28 17:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08c74d92-e668-5ac1-90ea-98cc9f4552dc, skipping ID generation
2026-01-28 17:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc with scrape type 1
2026-01-28 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 08c74d92-e668-5ac1-90ea-98cc9f4552dc from tracking dictionaries
2026-01-28 17:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08c74d92-e668-5ac1-90ea-98cc9f4552dc sending to next pipeline
2026-01-28 17:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 08c74d92-e668-5ac1-90ea-98cc9f4552dc, identifier: KN94003
2026-01-28 17:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 08c74d92-e668-5ac1-90ea-98cc9f4552dc with identifier: KN94003
2026-01-28 17:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 08c74d92-e668-5ac1-90ea-98cc9f4552dc with identifier: KN94003
2026-01-28 17:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 08c74d92-e668-5ac1-90ea-98cc9f4552dc with identifier: KN94003 to the API
2026-01-28 17:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_096a1a4e96c7c27f065e650cb629c501.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-01-29T16:44:38Z',
 'fuel_type': 'petrol',
 'id': '08c74d92-e668-5ac1-90ea-98cc9f4552dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN94003',
 'listing': 'auction',
 'location': 'ES, Málaga',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 128193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3384644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_096a1a4e96c7c27f065e650cb629c501.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2b3bcb2fa22b5b0c5efca7dba3a20a39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_dea2691f65f2bfc9c924daaa5c2650a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_2a83647df8af8e980c0ec9c56f16cdbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_29c58761309d96d276b216ec98d45c71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_fb4a423f1bdbd2a640111fdd244be1ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_b1bfdab501f84c7e3814cf72e0a282bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_f5dd719e0d3419f68c3b129751d89ca3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_319b14c84020fb639aa3d94be71be535.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_876a4da81b9f8d85fb6847f51dde1ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_48b76a4a3f0bdd5ae792fdab13e5958e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_5e7b9298d14a8eeb4654fd97cb783ec1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_85e62eb818e287f331b7076c2bfa0f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_1a2aa716408b5f4ec024a66146af85c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_8e7ee5ea3bf9654b557afccef435f4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08c74d92-e668-5ac1-90ea-98cc9f4552dc/08c74d92-e668-5ac1-90ea-98cc9f4552dc_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/5e/565e08d93dcf7da7ef35a3945f8e6b9e/pa/KN94003_0f70847febf77732dfab1897caf237cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Adam 1.4 Glam ecoFlex',
 'transmission': 'manual',
 'trim': 'Glam ecoFlex',
 'year': 2018}
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN94003%27 HTTP/1.1" 200 None
2026-01-28 17:05:00 [auto1.es] INFO: Saving data for KN94003: {'created_time': 1769619900.598081, 'last_price_update_time': 1769619900.598095, 'auction_closing_time': 1769705078.0}
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN94003') HTTP/1.1" 204 0
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU04753> (referer: https://www.auto1.com/v1/car-details-view/SU04753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR99640> (referer: https://www.auto1.com/v1/car-details-view/AR99640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF67982/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK27651/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW59429> (referer: https://www.auto1.com/v1/car-details-view/JW59429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW47045> (referer: https://www.auto1.com/v1/car-details-view/SW47045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB81076> (referer: https://www.auto1.com/v1/car-details-view/BB81076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2026-01-28 17:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de41b0d4-fbab-575b-99e3-86f43edc6c7a with scrape type 2
2026-01-28 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de41b0d4-fbab-575b-99e3-86f43edc6c7a with scrape type 2
2026-01-28 17:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de41b0d4-fbab-575b-99e3-86f43edc6c7a, identifier: YC26234
2026-01-28 17:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2026-01-28 17:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de41b0d4-fbab-575b-99e3-86f43edc6c7a with identifier: YC26234
2026-01-28 17:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: de41b0d4-fbab-575b-99e3-86f43edc6c7a spider: auto1.es
2026-01-28 17:05:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: de41b0d4-fbab-575b-99e3-86f43edc6c7a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:35:57Z',
 'fuel_type': 'diesel',
 'id': 'de41b0d4-fbab-575b-99e3-86f43edc6c7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC26234',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 160760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC26234%27 HTTP/1.1" 200 None
2026-01-28 17:05:00 [auto1.es] INFO: Saving data for YC26234: {'auction_closing_time': 1769704557.0, 'created_time': 1768237928.478711, 'last_price_update_time': 1769619900.959969}
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC26234') HTTP/1.1" 204 0
2026-01-28 17:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with identifier: SU04753
2026-01-28 17:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with scrape type 2
2026-01-28 17:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4, identifier: SU04753
2026-01-28 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504dc055-2912-5a07-a941-2135de7aa8e1 with identifier: AR99640
2026-01-28 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504dc055-2912-5a07-a941-2135de7aa8e1 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504dc055-2912-5a07-a941-2135de7aa8e1 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 504dc055-2912-5a07-a941-2135de7aa8e1, identifier: AR99640
2026-01-28 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f887d9cf-10c5-57f5-ba09-b257abe93185 with identifier: JW59429
2026-01-28 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f887d9cf-10c5-57f5-ba09-b257abe93185 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f887d9cf-10c5-57f5-ba09-b257abe93185 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f887d9cf-10c5-57f5-ba09-b257abe93185, identifier: JW59429
2026-01-28 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a9e3d9-1608-542a-bf89-0cb04016ae32 with identifier: SW47045
2026-01-28 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a9e3d9-1608-542a-bf89-0cb04016ae32 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a9e3d9-1608-542a-bf89-0cb04016ae32 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75a9e3d9-1608-542a-bf89-0cb04016ae32, identifier: SW47045
2026-01-28 17:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 with identifier: BB81076
2026-01-28 17:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 with scrape type 2
2026-01-28 17:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28, identifier: BB81076
2026-01-28 17:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with identifier: SU04753
2026-01-28 17:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with identifier: SU04753
2026-01-28 17:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4 with identifier: SU04753 to the API
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SU04753>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:28:03Z',
 'fuel_type': 'diesel',
 'id': '30b2743a-b5c2-5bbf-9b84-e8d3aeaa37b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU04753',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 138137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro Black line',
 'transmission': 'automatic',
 'trim': 'quattro Black line',
 'year': 2021}
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU04753%27 HTTP/1.1" 200 None
2026-01-28 17:05:01 [auto1.es] INFO: Saving data for SU04753: {'auction_closing_time': 1769704083.0, 'created_time': 1769101410.59251, 'last_price_update_time': 1769619901.880425}
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU04753') HTTP/1.1" 204 0
2026-01-28 17:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 504dc055-2912-5a07-a941-2135de7aa8e1 with identifier: AR99640
2026-01-28 17:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 504dc055-2912-5a07-a941-2135de7aa8e1 with identifier: AR99640
2026-01-28 17:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 78493, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar99640', 'expiration_date': '2026-01-29t16:42:21z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '504dc055-2912-5a07-a941-2135de7aa8e1', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 78493}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:42:21z',
     'fuel_type': 'electro',
     'id': '504dc055-2912-5a07-a941-2135de7aa8e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar99640',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 78493,
     'odometer_in_km': 78493,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 504dc055-2912-5a07-a941-2135de7aa8e1 spider: auto1.es
2026-01-28 17:05:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 504dc055-2912-5a07-a941-2135de7aa8e1 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 78493, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar99640', 'expiration_date': '2026-01-29t16:42:21z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '504dc055-2912-5a07-a941-2135de7aa8e1', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 78493}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:42:21z',
     'fuel_type': 'electro',
     'id': '504dc055-2912-5a07-a941-2135de7aa8e1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ar99640',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 78493,
     'odometer_in_km': 78493,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:42:21Z',
 'fuel_type': 'electro',
 'id': '504dc055-2912-5a07-a941-2135de7aa8e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR99640',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 78493,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR99640%27 HTTP/1.1" 200 None
2026-01-28 17:05:02 [auto1.es] INFO: Saving data for AR99640: {'auction_closing_time': 1769704941.0, 'created_time': 1768237663.829264, 'last_price_update_time': 1769619902.116038}
2026-01-28 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR99640') HTTP/1.1" 204 0
2026-01-28 17:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f887d9cf-10c5-57f5-ba09-b257abe93185 with identifier: JW59429
2026-01-28 17:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f887d9cf-10c5-57f5-ba09-b257abe93185 with identifier: JW59429
2026-01-28 17:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f887d9cf-10c5-57f5-ba09-b257abe93185 with identifier: JW59429 to the API
2026-01-28 17:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JW59429>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:53:57Z',
 'fuel_type': 'diesel',
 'id': 'f887d9cf-10c5-57f5-ba09-b257abe93185',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW59429',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 128359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW59429%27 HTTP/1.1" 200 None
2026-01-28 17:05:03 [auto1.es] INFO: Saving data for JW59429: {'auction_closing_time': 1769705637.0, 'created_time': 1768401410.152589, 'last_price_update_time': 1769619903.154587}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW59429') HTTP/1.1" 204 0
2026-01-28 17:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75a9e3d9-1608-542a-bf89-0cb04016ae32 with identifier: SW47045
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75a9e3d9-1608-542a-bf89-0cb04016ae32 with identifier: SW47045
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184393 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184393
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 75a9e3d9-1608-542a-bf89-0cb04016ae32 spider: auto1.es
2026-01-28 17:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 75a9e3d9-1608-542a-bf89-0cb04016ae32 due to rule: high_mileage_for_country.json, error: 184393 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184393
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:49:45Z',
 'fuel_type': 'diesel',
 'id': '75a9e3d9-1608-542a-bf89-0cb04016ae32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW47045',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 184393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Limousine 30 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2020}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW47045%27 HTTP/1.1" 200 None
2026-01-28 17:05:03 [auto1.es] INFO: Saving data for SW47045: {'auction_closing_time': 1769705385.0, 'created_time': 1769101496.567085, 'last_price_update_time': 1769619903.386272}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW47045') HTTP/1.1" 204 0
2026-01-28 17:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 with identifier: BB81076
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 with identifier: BB81076
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 spider: auto1.es
2026-01-28 17:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:10:57Z',
 'fuel_type': 'diesel',
 'id': 'ee48cf7f-b5b4-511a-beb3-5b4cc6fdac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB81076',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 160105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BB81076%27 HTTP/1.1" 200 None
2026-01-28 17:05:03 [auto1.es] INFO: Saving data for BB81076: {'auction_closing_time': 1769703057.0, 'created_time': 1768410546.449024, 'last_price_update_time': 1769619903.620707}
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BB81076') HTTP/1.1" 204 0
2026-01-28 17:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL80540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX11079/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ88191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT67329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZF50859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU98177> (referer: https://www.auto1.com/v1/car-details-view/BU98177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZN75442> (referer: https://www.auto1.com/v1/car-details-view/ZN75442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:04 [scrapy.extensions.logstats] INFO: Crawled 696 pages (at 153 pages/min), scraped 189 items (at 37 items/min)
2026-01-28 17:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a035c800-db57-5154-b465-5618dac2aff4 with identifier: BU98177
2026-01-28 17:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a035c800-db57-5154-b465-5618dac2aff4 with scrape type 2
2026-01-28 17:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a035c800-db57-5154-b465-5618dac2aff4 with scrape type 2
2026-01-28 17:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a035c800-db57-5154-b465-5618dac2aff4, identifier: BU98177
2026-01-28 17:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a035c800-db57-5154-b465-5618dac2aff4 with identifier: BU98177
2026-01-28 17:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a035c800-db57-5154-b465-5618dac2aff4 with identifier: BU98177
2026-01-28 17:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a035c800-db57-5154-b465-5618dac2aff4 with identifier: BU98177 to the API
2026-01-28 17:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU98177>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 179,
 'expiration_date': '2026-01-29T16:41:13Z',
 'fuel_type': 'diesel',
 'id': 'a035c800-db57-5154-b465-5618dac2aff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU98177',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Citroen',
 'model': 'C5 Aircross',
 'odometer': 128087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C5 Aircross 2.0 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2019}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU98177%27 HTTP/1.1" 200 None
2026-01-28 17:05:05 [auto1.es] INFO: Saving data for BU98177: {'auction_closing_time': 1769704873.0, 'created_time': 1768323676.784058, 'last_price_update_time': 1769619905.02103}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU98177') HTTP/1.1" 204 0
2026-01-28 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK58231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX65685> (referer: https://www.auto1.com/v1/car-details-view/JX65685/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9336c065-4886-5524-8523-e8f67eaeb534 with identifier: ZN75442
2026-01-28 17:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9336c065-4886-5524-8523-e8f67eaeb534 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9336c065-4886-5524-8523-e8f67eaeb534 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9336c065-4886-5524-8523-e8f67eaeb534, identifier: ZN75442
2026-01-28 17:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9336c065-4886-5524-8523-e8f67eaeb534 with identifier: ZN75442
2026-01-28 17:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9336c065-4886-5524-8523-e8f67eaeb534 with identifier: ZN75442
2026-01-28 17:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9336c065-4886-5524-8523-e8f67eaeb534 with identifier: ZN75442 to the API
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZN75442>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:02:35Z',
 'fuel_type': 'petrol',
 'id': '9336c065-4886-5524-8523-e8f67eaeb534',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN75442',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 70376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2022}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZN75442%27 HTTP/1.1" 200 None
2026-01-28 17:05:05 [auto1.es] INFO: Saving data for ZN75442: {'auction_closing_time': 1769702555.0, 'created_time': 1769447092.067768, 'last_price_update_time': 1769619905.475859}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZN75442') HTTP/1.1" 204 0
2026-01-28 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG59071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS38549> (referer: https://www.auto1.com/v1/car-details-view/TS38549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 009423e2-5164-54ee-9a13-caece11c69b8 with identifier: JX65685
2026-01-28 17:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 009423e2-5164-54ee-9a13-caece11c69b8 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 009423e2-5164-54ee-9a13-caece11c69b8 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 009423e2-5164-54ee-9a13-caece11c69b8, identifier: JX65685
2026-01-28 17:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 009423e2-5164-54ee-9a13-caece11c69b8 with identifier: JX65685
2026-01-28 17:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 009423e2-5164-54ee-9a13-caece11c69b8 with identifier: JX65685
2026-01-28 17:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193535 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193535
2026-01-28 17:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 009423e2-5164-54ee-9a13-caece11c69b8 spider: auto1.es
2026-01-28 17:05:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 009423e2-5164-54ee-9a13-caece11c69b8 due to rule: high_mileage_for_country.json, error: 193535 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193535
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:43:49Z',
 'fuel_type': 'diesel',
 'id': '009423e2-5164-54ee-9a13-caece11c69b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX65685',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 193535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.3 M-Jet Pop Business',
 'transmission': 'manual',
 'trim': 'Pop Business',
 'year': 2020}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JX65685%27 HTTP/1.1" 200 None
2026-01-28 17:05:05 [auto1.es] INFO: Saving data for JX65685: {'auction_closing_time': 1769705029.0, 'created_time': 1767891830.716098, 'last_price_update_time': 1769619905.810554}
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JX65685') HTTP/1.1" 204 0
2026-01-28 17:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG10753> (referer: https://www.auto1.com/v1/car-details-view/AG10753/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2026-01-28 17:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e60663c2-4570-5455-a931-d682fd238c75 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e60663c2-4570-5455-a931-d682fd238c75 with scrape type 2
2026-01-28 17:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e60663c2-4570-5455-a931-d682fd238c75, identifier: TS38549
2026-01-28 17:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2026-01-28 17:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e60663c2-4570-5455-a931-d682fd238c75 with identifier: TS38549
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e60663c2-4570-5455-a931-d682fd238c75 spider: auto1.es
2026-01-28 17:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e60663c2-4570-5455-a931-d682fd238c75 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:20:55Z',
 'fuel_type': 'diesel',
 'id': 'e60663c2-4570-5455-a931-d682fd238c75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS38549',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 148140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS38549%27 HTTP/1.1" 200 None
2026-01-28 17:05:06 [auto1.es] INFO: Saving data for TS38549: {'auction_closing_time': 1769703655.0, 'created_time': 1768237670.785103, 'last_price_update_time': 1769619906.164209}
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS38549') HTTP/1.1" 204 0
2026-01-28 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG20996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d6e367e-f584-51af-9a48-a3144023c8a5 with identifier: AG10753
2026-01-28 17:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d6e367e-f584-51af-9a48-a3144023c8a5 with scrape type 2
2026-01-28 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d6e367e-f584-51af-9a48-a3144023c8a5 with scrape type 2
2026-01-28 17:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3d6e367e-f584-51af-9a48-a3144023c8a5, identifier: AG10753
2026-01-28 17:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3d6e367e-f584-51af-9a48-a3144023c8a5 with identifier: AG10753
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3d6e367e-f584-51af-9a48-a3144023c8a5 with identifier: AG10753
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157853
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3d6e367e-f584-51af-9a48-a3144023c8a5 spider: auto1.es
2026-01-28 17:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3d6e367e-f584-51af-9a48-a3144023c8a5 due to rule: high_mileage_for_country.json, error: 157853 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157853
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:19:33Z',
 'fuel_type': 'diesel',
 'id': '3d6e367e-f584-51af-9a48-a3144023c8a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG10753',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 157853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2023}
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG10753%27 HTTP/1.1" 200 None
2026-01-28 17:05:06 [auto1.es] INFO: Saving data for AG10753: {'auction_closing_time': 1769703573.0, 'created_time': 1769101401.950831, 'last_price_update_time': 1769619906.496118}
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG10753') HTTP/1.1" 204 0
2026-01-28 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN63707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL42304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW01202> (referer: https://www.auto1.com/v1/car-details-view/NW01202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK27651> (referer: https://www.auto1.com/v1/car-details-view/PK27651/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184e24b4-dfac-53ee-ae98-e6d25c689a7b with identifier: NW01202
2026-01-28 17:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184e24b4-dfac-53ee-ae98-e6d25c689a7b with scrape type 2
2026-01-28 17:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184e24b4-dfac-53ee-ae98-e6d25c689a7b with scrape type 2
2026-01-28 17:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 184e24b4-dfac-53ee-ae98-e6d25c689a7b, identifier: NW01202
2026-01-28 17:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 184e24b4-dfac-53ee-ae98-e6d25c689a7b with identifier: NW01202
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 184e24b4-dfac-53ee-ae98-e6d25c689a7b with identifier: NW01202
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 184e24b4-dfac-53ee-ae98-e6d25c689a7b spider: auto1.es
2026-01-28 17:05:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 184e24b4-dfac-53ee-ae98-e6d25c689a7b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:46:21Z',
 'fuel_type': 'diesel',
 'id': '184e24b4-dfac-53ee-ae98-e6d25c689a7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW01202',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 64972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit 1.5 TDCi Furgon 200 L1 Ambiente',
 'transmission': 'manual',
 'trim': 'Furgon 200 L1 Ambiente',
 'year': 2018}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW01202%27 HTTP/1.1" 200 None
2026-01-28 17:05:07 [auto1.es] INFO: Saving data for NW01202: {'auction_closing_time': 1769705181.0, 'created_time': 1768928423.645165, 'last_price_update_time': 1769619907.013538}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW01202') HTTP/1.1" 204 0
2026-01-28 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL80540> (referer: https://www.auto1.com/v1/car-details-view/ZL80540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT97347/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2026-01-28 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb, identifier: PK27651
2026-01-28 17:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb with identifier: PK27651
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb spider: auto1.es
2026-01-28 17:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38a8e7c6-ece6-54ca-966f-2b478ffa87fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:18:17Z',
 'fuel_type': 'diesel',
 'id': '38a8e7c6-ece6-54ca-966f-2b478ffa87fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK27651',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 118972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2022}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK27651%27 HTTP/1.1" 200 None
2026-01-28 17:05:07 [auto1.es] INFO: Saving data for PK27651: {'auction_closing_time': 1769703497.0, 'created_time': 1768237672.819154, 'last_price_update_time': 1769619907.351791}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK27651') HTTP/1.1" 204 0
2026-01-28 17:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF67982> (referer: https://www.auto1.com/v1/car-details-view/WF67982/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-01-28 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 186f73d9-8486-5d5f-92e8-8a38cdf151bd with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 186f73d9-8486-5d5f-92e8-8a38cdf151bd, identifier: ZL80540
2026-01-28 17:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540
2026-01-28 17:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 186f73d9-8486-5d5f-92e8-8a38cdf151bd with identifier: ZL80540 to the API
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL80540>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 250,
 'expiration_date': '2026-01-29T16:53:01Z',
 'fuel_type': 'petrol',
 'id': '186f73d9-8486-5d5f-92e8-8a38cdf151bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL80540',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 87993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 2.0 Turbo SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2020}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL80540%27 HTTP/1.1" 200 None
2026-01-28 17:05:07 [auto1.es] INFO: Saving data for ZL80540: {'auction_closing_time': 1769705581.0, 'created_time': 1768237329.148415, 'last_price_update_time': 1769619907.774285}
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL80540') HTTP/1.1" 204 0
2026-01-28 17:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db565108-bc4b-5339-bcfa-d61fb3d72303 with identifier: WF67982
2026-01-28 17:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db565108-bc4b-5339-bcfa-d61fb3d72303 with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db565108-bc4b-5339-bcfa-d61fb3d72303 with scrape type 2
2026-01-28 17:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db565108-bc4b-5339-bcfa-d61fb3d72303, identifier: WF67982
2026-01-28 17:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db565108-bc4b-5339-bcfa-d61fb3d72303 with identifier: WF67982
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db565108-bc4b-5339-bcfa-d61fb3d72303 with identifier: WF67982
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 17:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: db565108-bc4b-5339-bcfa-d61fb3d72303 spider: auto1.es
2026-01-28 17:05:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: db565108-bc4b-5339-bcfa-d61fb3d72303 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:08:38Z',
 'fuel_type': 'diesel',
 'id': 'db565108-bc4b-5339-bcfa-d61fb3d72303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF67982',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 159661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-23',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid L1 Trend',
 'transmission': 'manual',
 'trim': 'L1 Trend',
 'year': 2022}
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF67982%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [auto1.es] INFO: Saving data for WF67982: {'auction_closing_time': 1769702918.0, 'created_time': 1768410544.833217, 'last_price_update_time': 1769619908.169232}
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WF67982') HTTP/1.1" 204 0
2026-01-28 17:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZU80420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZF50859> (referer: https://www.auto1.com/v1/car-details-view/ZF50859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX11079> (referer: https://www.auto1.com/v1/car-details-view/VX11079/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ88191> (referer: https://www.auto1.com/v1/car-details-view/LZ88191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2026-01-28 17:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with scrape type 2
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with scrape type 2
2026-01-28 17:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e, identifier: ZF50859
2026-01-28 17:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e87976b-49c4-56cf-8027-7560d1b34f82 with identifier: VX11079
2026-01-28 17:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e87976b-49c4-56cf-8027-7560d1b34f82 with scrape type 1
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2e87976b-49c4-56cf-8027-7560d1b34f82
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_794f1375819c6affa5bb4d3360e46367.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_794f1375819c6affa5bb4d3360e46367.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_1e130733d28f61e6ef35840b678efc84.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1e130733d28f61e6ef35840b678efc84.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_ae5193822e8bea91e1f4842d71344197.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_ae5193822e8bea91e1f4842d71344197.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_d955c12d65e317a5b468ff323e6af338.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d955c12d65e317a5b468ff323e6af338.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_fff382ccb32bdf5ce0994723f96808e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_fff382ccb32bdf5ce0994723f96808e2.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_05b51d6076b94917c7fa8cace249264f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_05b51d6076b94917c7fa8cace249264f.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_9e149d5d6dda38457c0dc335c93238b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_9e149d5d6dda38457c0dc335c93238b3.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_c9be08796ff59671f7c30cec6fadaa7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_c9be08796ff59671f7c30cec6fadaa7c.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_1475aef1107ae84b498af6c9e15cc9dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1475aef1107ae84b498af6c9e15cc9dc.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_55f6d78e0dc5c4c4aae3dde057c65a41.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_55f6d78e0dc5c4c4aae3dde057c65a41.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_eff242f9ca536bab51d604c0237fb1a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_eff242f9ca536bab51d604c0237fb1a3.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_3743dcec359c9f72bddae565062e3c0f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_3743dcec359c9f72bddae565062e3c0f.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_54870d52381af88a6765e589473bab82.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_54870d52381af88a6765e589473bab82.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_377eb9d7cf584218ec011fefc240c6c5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_377eb9d7cf584218ec011fefc240c6c5.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_d2cc4421f5d2be0b79a2905824ed3452.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d2cc4421f5d2be0b79a2905824ed3452.jpg already downloaded
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252Ffd%252Fe0fd694b39d6f10b0c3a880470bc1e09%252Fpa%252FVX11079_0fcee09e83b41107194d06a14dea9082.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_0fcee09e83b41107194d06a14dea9082.jpg already downloaded
2026-01-28 17:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e87976b-49c4-56cf-8027-7560d1b34f82, identifier: VX11079
2026-01-28 17:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2026-01-28 17:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859
2026-01-28 17:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1ed79263-0d3c-5f50-afe0-7155c8c0fa7e with identifier: ZF50859 to the API
2026-01-28 17:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZF50859>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:27:43Z',
 'fuel_type': 'diesel',
 'id': '1ed79263-0d3c-5f50-afe0-7155c8c0fa7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF50859',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 121190,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D165 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2021}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF50859%27 HTTP/1.1" 200 None
2026-01-28 17:05:09 [auto1.es] INFO: Saving data for ZF50859: {'auction_closing_time': 1769704063.0, 'created_time': 1768237897.927295, 'last_price_update_time': 1769619909.195972}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZF50859') HTTP/1.1" 204 0
2026-01-28 17:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e87976b-49c4-56cf-8027-7560d1b34f82 with identifier: VX11079
2026-01-28 17:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e87976b-49c4-56cf-8027-7560d1b34f82 with identifier: VX11079
2026-01-28 17:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
2026-01-28 17:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2e87976b-49c4-56cf-8027-7560d1b34f82 spider: auto1.es
2026-01-28 17:05:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2e87976b-49c4-56cf-8027-7560d1b34f82 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 223,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '2e87976b-49c4-56cf-8027-7560d1b34f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX11079',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 182362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_794f1375819c6affa5bb4d3360e46367.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1e130733d28f61e6ef35840b678efc84.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_ae5193822e8bea91e1f4842d71344197.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d955c12d65e317a5b468ff323e6af338.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_fff382ccb32bdf5ce0994723f96808e2.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_05b51d6076b94917c7fa8cace249264f.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_9e149d5d6dda38457c0dc335c93238b3.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_c9be08796ff59671f7c30cec6fadaa7c.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1475aef1107ae84b498af6c9e15cc9dc.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_55f6d78e0dc5c4c4aae3dde057c65a41.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_eff242f9ca536bab51d604c0237fb1a3.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_3743dcec359c9f72bddae565062e3c0f.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_54870d52381af88a6765e589473bab82.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_377eb9d7cf584218ec011fefc240c6c5.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d2cc4421f5d2be0b79a2905824ed3452.jpg',
                'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_0fcee09e83b41107194d06a14dea9082.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_794f1375819c6affa5bb4d3360e46367.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1e130733d28f61e6ef35840b678efc84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_ae5193822e8bea91e1f4842d71344197.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d955c12d65e317a5b468ff323e6af338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_fff382ccb32bdf5ce0994723f96808e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_05b51d6076b94917c7fa8cace249264f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_9e149d5d6dda38457c0dc335c93238b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_c9be08796ff59671f7c30cec6fadaa7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_1475aef1107ae84b498af6c9e15cc9dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_55f6d78e0dc5c4c4aae3dde057c65a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_eff242f9ca536bab51d604c0237fb1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_3743dcec359c9f72bddae565062e3c0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_54870d52381af88a6765e589473bab82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70243,
             'Height': 571,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_377eb9d7cf584218ec011fefc240c6c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70703,
             'Height': 563,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_d2cc4421f5d2be0b79a2905824ed3452.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e87976b-49c4-56cf-8027-7560d1b34f82/2e87976b-49c4-56cf-8027-7560d1b34f82_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/fd/e0fd694b39d6f10b0c3a880470bc1e09/pa/VX11079_0fcee09e83b41107194d06a14dea9082.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-14',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 30 L1H1',
 'transmission': 'manual',
 'trim': '30 L1H1',
 'year': 2021}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX11079%27 HTTP/1.1" 200 None
2026-01-28 17:05:09 [auto1.es] INFO: Saving data for VX11079: {'created_time': 1769619909.446029, 'last_price_update_time': 1769619909.44604, 'auction_closing_time': 1769705006.0}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VX11079') HTTP/1.1" 204 0
2026-01-28 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK58231> (referer: https://www.auto1.com/v1/car-details-view/VK58231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KX91354/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TG55276> (referer: https://www.auto1.com/v1/car-details-view/TG55276/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with identifier: LZ88191
2026-01-28 17:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with scrape type 2
2026-01-28 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with scrape type 2
2026-01-28 17:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f, identifier: LZ88191
2026-01-28 17:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with identifier: LZ88191
2026-01-28 17:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with identifier: LZ88191
2026-01-28 17:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d3b36e9-6aa3-5ceb-981e-85d17b2d551f with identifier: LZ88191 to the API
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LZ88191>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 106,
 'expiration_date': '2026-01-29T16:44:10Z',
 'fuel_type': 'petrol',
 'id': '0d3b36e9-6aa3-5ceb-981e-85d17b2d551f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ88191',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 71490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2023}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LZ88191%27 HTTP/1.1" 200 None
2026-01-28 17:05:09 [auto1.es] INFO: Saving data for LZ88191: {'auction_closing_time': 1769705050.0, 'created_time': 1768410126.316781, 'last_price_update_time': 1769619909.863929}
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LZ88191') HTTP/1.1" 204 0
2026-01-28 17:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT67329> (referer: https://www.auto1.com/v1/car-details-view/CT67329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94ccea89-8fc5-54ec-9f36-60983ea235c4 with identifier: VK58231
2026-01-28 17:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94ccea89-8fc5-54ec-9f36-60983ea235c4 with scrape type 2
2026-01-28 17:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94ccea89-8fc5-54ec-9f36-60983ea235c4 with scrape type 2
2026-01-28 17:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 94ccea89-8fc5-54ec-9f36-60983ea235c4, identifier: VK58231
2026-01-28 17:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-01-28 17:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cc8932-01b7-5bbe-bdad-7e177f727479 with scrape type 2
2026-01-28 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50cc8932-01b7-5bbe-bdad-7e177f727479 with scrape type 2
2026-01-28 17:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 50cc8932-01b7-5bbe-bdad-7e177f727479, identifier: TG55276
2026-01-28 17:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 94ccea89-8fc5-54ec-9f36-60983ea235c4 with identifier: VK58231
2026-01-28 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 94ccea89-8fc5-54ec-9f36-60983ea235c4 with identifier: VK58231
2026-01-28 17:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 94ccea89-8fc5-54ec-9f36-60983ea235c4 with identifier: VK58231 to the API
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VK58231>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:51:34Z',
 'fuel_type': 'diesel',
 'id': '94ccea89-8fc5-54ec-9f36-60983ea235c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK58231',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123349,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VK58231%27 HTTP/1.1" 200 None
2026-01-28 17:05:10 [auto1.es] INFO: Saving data for VK58231: {'auction_closing_time': 1769705494.0, 'created_time': 1769493633.703143, 'last_price_update_time': 1769619910.532774}
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VK58231') HTTP/1.1" 204 0
2026-01-28 17:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-01-28 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 50cc8932-01b7-5bbe-bdad-7e177f727479 with identifier: TG55276
2026-01-28 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199347 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199347
2026-01-28 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 50cc8932-01b7-5bbe-bdad-7e177f727479 spider: auto1.es
2026-01-28 17:05:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 50cc8932-01b7-5bbe-bdad-7e177f727479 due to rule: high_mileage_for_country.json, error: 199347 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199347
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:28:23Z',
 'fuel_type': 'diesel',
 'id': '50cc8932-01b7-5bbe-bdad-7e177f727479',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG55276',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 199347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 30 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2022}
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TG55276%27 HTTP/1.1" 200 None
2026-01-28 17:05:10 [auto1.es] INFO: Saving data for TG55276: {'auction_closing_time': 1769704103.0, 'created_time': 1769061724.979454, 'last_price_update_time': 1769619910.782712}
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TG55276') HTTP/1.1" 204 0
2026-01-28 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG20996> (referer: https://www.auto1.com/v1/car-details-view/BG20996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG47270> (referer: https://www.auto1.com/v1/car-details-view/ZG47270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG59071> (referer: https://www.auto1.com/v1/car-details-view/WG59071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU17252> (referer: https://www.auto1.com/v1/car-details-view/XU17252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2026-01-28 17:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0a81d7-4862-5d6a-8ff6-80787393969f with scrape type 2
2026-01-28 17:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0a81d7-4862-5d6a-8ff6-80787393969f with scrape type 2
2026-01-28 17:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c0a81d7-4862-5d6a-8ff6-80787393969f, identifier: CT67329
2026-01-28 17:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2026-01-28 17:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c0a81d7-4862-5d6a-8ff6-80787393969f with identifier: CT67329
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1c0a81d7-4862-5d6a-8ff6-80787393969f spider: auto1.es
2026-01-28 17:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1c0a81d7-4862-5d6a-8ff6-80787393969f due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:57:51Z',
 'fuel_type': 'diesel',
 'id': '1c0a81d7-4862-5d6a-8ff6-80787393969f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT67329',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 125755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2022}
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CT67329%27 HTTP/1.1" 200 None
2026-01-28 17:05:11 [auto1.es] INFO: Saving data for CT67329: {'auction_closing_time': 1769705871.0, 'created_time': 1768237940.498381, 'last_price_update_time': 1769619911.152334}
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CT67329') HTTP/1.1" 204 0
2026-01-28 17:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c6a9149-991d-5c82-9283-cd7af6857f66 with identifier: BG20996
2026-01-28 17:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6a9149-991d-5c82-9283-cd7af6857f66 with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c6a9149-991d-5c82-9283-cd7af6857f66 with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6c6a9149-991d-5c82-9283-cd7af6857f66, identifier: BG20996
2026-01-28 17:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d with identifier: ZG47270
2026-01-28 17:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d, identifier: ZG47270
2026-01-28 17:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-01-28 17:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b, identifier: WG59071
2026-01-28 17:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with identifier: XU17252
2026-01-28 17:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with scrape type 2
2026-01-28 17:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22, identifier: XU17252
2026-01-28 17:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6c6a9149-991d-5c82-9283-cd7af6857f66 with identifier: BG20996
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6c6a9149-991d-5c82-9283-cd7af6857f66 with identifier: BG20996
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175298 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175298
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6c6a9149-991d-5c82-9283-cd7af6857f66 spider: auto1.es
2026-01-28 17:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6c6a9149-991d-5c82-9283-cd7af6857f66 due to rule: high_mileage_for_country.json, error: 175298 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175298
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:44:25Z',
 'fuel_type': 'petrol',
 'id': '6c6a9149-991d-5c82-9283-cd7af6857f66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG20996',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 175298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG20996%27 HTTP/1.1" 200 None
2026-01-28 17:05:11 [auto1.es] INFO: Saving data for BG20996: {'auction_closing_time': 1769705065.0, 'created_time': 1764153954.253196, 'last_price_update_time': 1769619911.829042}
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG20996') HTTP/1.1" 204 0
2026-01-28 17:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d with identifier: ZG47270
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d with identifier: ZG47270
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'movano' containing 'movano'
2026-01-28 17:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d spider: auto1.es
2026-01-28 17:05:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'movano' containing 'movano'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:15:28Z',
 'fuel_type': 'diesel',
 'id': 'eca9eaa6-0320-5dd8-aaca-9d6d2159ac4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG47270',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 58906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-01-02',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Movano 2.2 CDTI HKa L4H2 3,5t Selection verstärkt',
 'transmission': 'manual',
 'trim': 'HKa L4H2 3,5t Selection verstärkt',
 'year': 2022}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG47270%27 HTTP/1.1" 200 None
2026-01-28 17:05:12 [auto1.es] INFO: Saving data for ZG47270: {'auction_closing_time': 1769703328.0, 'created_time': 1767978254.433617, 'last_price_update_time': 1769619912.070566}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG47270') HTTP/1.1" 204 0
2026-01-28 17:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-01-28 17:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071
2026-01-28 17:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e1af7fb0-b7e0-547e-9d3e-754b8837bd8b with identifier: WG59071 to the API
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG59071>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:42:26Z',
 'fuel_type': 'diesel',
 'id': 'e1af7fb0-b7e0-547e-9d3e-754b8837bd8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG59071',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 112361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WG59071%27 HTTP/1.1" 200 None
2026-01-28 17:05:12 [auto1.es] INFO: Saving data for WG59071: {'auction_closing_time': 1769704946.0, 'created_time': 1768237355.722322, 'last_price_update_time': 1769619912.433841}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WG59071') HTTP/1.1" 204 0
2026-01-28 17:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with identifier: XU17252
2026-01-28 17:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with identifier: XU17252
2026-01-28 17:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22 with identifier: XU17252 to the API
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XU17252>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:20:15Z',
 'fuel_type': 'petrol',
 'id': 'c4a96b4c-5c85-57e3-81fb-b5f7a6f6da22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU17252',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 20150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2023}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU17252%27 HTTP/1.1" 200 None
2026-01-28 17:05:12 [auto1.es] INFO: Saving data for XU17252: {'auction_closing_time': 1769703615.0, 'created_time': 1767780228.301838, 'last_price_update_time': 1769619912.847571}
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XU17252') HTTP/1.1" 204 0
2026-01-28 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XG14528/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN63707> (referer: https://www.auto1.com/v1/car-details-view/FN63707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL42304> (referer: https://www.auto1.com/v1/car-details-view/AL42304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb with identifier: FN63707
2026-01-28 17:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb with scrape type 1
2026-01-28 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_6176bdbacbec72389819f127eecfa3b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_6176bdbacbec72389819f127eecfa3b4.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_22dcf4325067e9da750e987212108d65.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_22dcf4325067e9da750e987212108d65.jpg not downloaded yet
2026-01-28 17:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45eeb304-1fc5-5287-8a47-20ebaca389ee with identifier: AL42304
2026-01-28 17:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45eeb304-1fc5-5287-8a47-20ebaca389ee with scrape type 2
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45eeb304-1fc5-5287-8a47-20ebaca389ee with scrape type 2
2026-01-28 17:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45eeb304-1fc5-5287-8a47-20ebaca389ee, identifier: AL42304
2026-01-28 17:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45eeb304-1fc5-5287-8a47-20ebaca389ee with identifier: AL42304
2026-01-28 17:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45eeb304-1fc5-5287-8a47-20ebaca389ee with identifier: AL42304
2026-01-28 17:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
2026-01-28 17:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 45eeb304-1fc5-5287-8a47-20ebaca389ee spider: auto1.es
2026-01-28 17:05:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 45eeb304-1fc5-5287-8a47-20ebaca389ee due to rule: makes_models_not_allowed.json, error: Rejected due to make 'dacia' containing 'dacia' and model 'lodgy' containing 'lodgy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:47:11Z',
 'fuel_type': 'petrol',
 'id': '45eeb304-1fc5-5287-8a47-20ebaca389ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL42304',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 65082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Lodgy 1.3 TCe 15 ans',
 'transmission': 'manual',
 'trim': '15 ans',
 'year': 2020}
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL42304%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [auto1.es] INFO: Saving data for AL42304: {'auction_closing_time': 1769705231.0, 'created_time': 1768842204.419738, 'last_price_update_time': 1769619913.302081}
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL42304') HTTP/1.1" 204 0
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_478c71dab0dd90953f44ea2d5da64690.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_478c71dab0dd90953f44ea2d5da64690.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_2202e5727e12a772bdd972d6a3814a72.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2202e5727e12a772bdd972d6a3814a72.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_c24f486f4d576ec8c12fe420731b128d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_c24f486f4d576ec8c12fe420731b128d.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_dad0a36f4f73b1720f1604155b6d9470.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_dad0a36f4f73b1720f1604155b6d9470.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg not downloaded yet
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK72365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg not downloaded yet
2026-01-28 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT53297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_e29c061883942b5d1536dc05ce234041.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_e29c061883942b5d1536dc05ce234041.jpg not downloaded yet
2026-01-28 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF21345/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_930e0fc728b067f80dd1427c0c678cb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_930e0fc728b067f80dd1427c0c678cb9.jpg not downloaded yet
2026-01-28 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_88462de8894c8454e8464f782f602574.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_88462de8894c8454e8464f782f602574.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg not downloaded yet
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg not downloaded yet
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_e29c061883942b5d1536dc05ce234041.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP23605/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT97347> (referer: https://www.auto1.com/v1/car-details-view/HT97347/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62650710>
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_e29c061883942b5d1536dc05ce234041.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_e29c061883942b5d1536dc05ce234041.jpg saved to cache
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62653490>
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg saved to cache
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2026-01-28 17:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with scrape type 2
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with scrape type 2
2026-01-28 17:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae, identifier: HT97347
2026-01-28 17:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2026-01-28 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae with identifier: HT97347
2026-01-28 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
2026-01-28 17:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae spider: auto1.es
2026-01-28 17:05:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-01-29T16:28:30Z',
 'fuel_type': 'gas',
 'id': 'dcb6d06b-9161-5bbf-9ecf-af4b9012c0ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT97347',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 198713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Fiorino 1.4 SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2020}
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT97347%27 HTTP/1.1" 200 None
2026-01-28 17:05:14 [auto1.es] INFO: Saving data for HT97347: {'auction_closing_time': 1769704110.0, 'created_time': 1769014825.122304, 'last_price_update_time': 1769619914.638}
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT97347') HTTP/1.1" 204 0
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU13655/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH31906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZU80420> (referer: https://www.auto1.com/v1/car-details-view/ZU80420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU80810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_88462de8894c8454e8464f782f602574.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK36177/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KX91354> (referer: https://www.auto1.com/v1/car-details-view/KX91354/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627282d0>
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg saved to cache
2026-01-28 17:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62653890>
2026-01-28 17:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg saved to cache
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6bb90>
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg saved to cache
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-01-28 17:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with scrape type 2
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with scrape type 2
2026-01-28 17:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d7e8f7ec-765a-52bc-bd26-2408c37a7c08, identifier: ZU80420
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289c050>
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_88462de8894c8454e8464f782f602574.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_88462de8894c8454e8464f782f602574.jpg saved to cache
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2026-01-28 17:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42e8c0a-1766-5869-b6b5-2278a04ee3da with scrape type 2
2026-01-28 17:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42e8c0a-1766-5869-b6b5-2278a04ee3da with scrape type 2
2026-01-28 17:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b42e8c0a-1766-5869-b6b5-2278a04ee3da, identifier: KX91354
2026-01-28 17:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-01-28 17:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420
2026-01-28 17:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d7e8f7ec-765a-52bc-bd26-2408c37a7c08 with identifier: ZU80420 to the API
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZU80420>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:23:07Z',
 'fuel_type': 'petrol',
 'id': 'd7e8f7ec-765a-52bc-bd26-2408c37a7c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU80420',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 22566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2023}
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZU80420%27 HTTP/1.1" 200 None
2026-01-28 17:05:16 [auto1.es] INFO: Saving data for ZU80420: {'auction_closing_time': 1769703787.0, 'created_time': 1768410456.840322, 'last_price_update_time': 1769619916.608707}
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZU80420') HTTP/1.1" 204 0
2026-01-28 17:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2026-01-28 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b42e8c0a-1766-5869-b6b5-2278a04ee3da with identifier: KX91354
2026-01-28 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b42e8c0a-1766-5869-b6b5-2278a04ee3da spider: auto1.es
2026-01-28 17:05:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b42e8c0a-1766-5869-b6b5-2278a04ee3da due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:40:07Z',
 'fuel_type': 'diesel',
 'id': 'b42e8c0a-1766-5869-b6b5-2278a04ee3da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX91354',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 142068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-04',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KX91354%27 HTTP/1.1" 200 None
2026-01-28 17:05:16 [auto1.es] INFO: Saving data for KX91354: {'auction_closing_time': 1769704807.0, 'created_time': 1768237358.160384, 'last_price_update_time': 1769619916.823555}
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KX91354') HTTP/1.1" 204 0
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_930e0fc728b067f80dd1427c0c678cb9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_dad0a36f4f73b1720f1604155b6d9470.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2202e5727e12a772bdd972d6a3814a72.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_c24f486f4d576ec8c12fe420731b128d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH79865/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_6176bdbacbec72389819f127eecfa3b4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62735b50>
2026-01-28 17:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg saved to cache
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_22dcf4325067e9da750e987212108d65.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_478c71dab0dd90953f44ea2d5da64690.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f4d90>
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_930e0fc728b067f80dd1427c0c678cb9.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_930e0fc728b067f80dd1427c0c678cb9.jpg saved to cache
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628e6610>
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_dad0a36f4f73b1720f1604155b6d9470.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_dad0a36f4f73b1720f1604155b6d9470.jpg saved to cache
2026-01-28 17:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f9d90>
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg saved to cache
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289d850>
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_2202e5727e12a772bdd972d6a3814a72.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2202e5727e12a772bdd972d6a3814a72.jpg saved to cache
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f4a50>
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_c24f486f4d576ec8c12fe420731b128d.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_c24f486f4d576ec8c12fe420731b128d.jpg saved to cache
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a2fd90>
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg saved to cache
2026-01-28 17:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289c710>
2026-01-28 17:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_6176bdbacbec72389819f127eecfa3b4.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_6176bdbacbec72389819f127eecfa3b4.jpg saved to cache
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC75424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH83522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT53297> (referer: https://www.auto1.com/v1/car-details-view/BT53297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP81684/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK72365> (referer: https://www.auto1.com/v1/car-details-view/BK72365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF21345> (referer: https://www.auto1.com/v1/car-details-view/SF21345/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG09681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b4910>
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_22dcf4325067e9da750e987212108d65.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_22dcf4325067e9da750e987212108d65.jpg saved to cache
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62656290>
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252Fd8%252Ffcd84464835bbcd4ab8f6a689a7d5b10%252Fpa%252FFN63707_478c71dab0dd90953f44ea2d5da64690.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_478c71dab0dd90953f44ea2d5da64690.jpg saved to cache
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb
2026-01-28 17:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb, skipping ID generation
2026-01-28 17:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb with scrape type 1
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb from tracking dictionaries
2026-01-28 17:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb sending to next pipeline
2026-01-28 17:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb, identifier: FN63707
2026-01-28 17:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb with identifier: FN63707
2026-01-28 17:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb with identifier: FN63707
2026-01-28 17:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb spider: auto1.es
2026-01-28 17:05:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:24:21Z',
 'fuel_type': 'diesel',
 'id': '1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN63707',
 'listing': 'auction',
 'location': 'ES, Marbella',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 97389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_6176bdbacbec72389819f127eecfa3b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_22dcf4325067e9da750e987212108d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_478c71dab0dd90953f44ea2d5da64690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2202e5727e12a772bdd972d6a3814a72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_c24f486f4d576ec8c12fe420731b128d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_dad0a36f4f73b1720f1604155b6d9470.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_d6737726e6ced02bd1a4ee2d4f860bff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_9e4d208767de5ca40781f6cbe0c1a0a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1cd81edbfd97fb734b708fab132dd6a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_e29c061883942b5d1536dc05ce234041.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_930e0fc728b067f80dd1427c0c678cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_fc3bb91ac72a802be64328cf26f1cef8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_2cbbc4bdeef547c6fa80806790ac2549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_88462de8894c8454e8464f782f602574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_b3637a4977dd008caa3f16bc47f6ce40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb/1c8f2f6c-3b98-5701-8ba5-adfb0e13e9bb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/d8/fcd84464835bbcd4ab8f6a689a7d5b10/pa/FN63707_1b91dabf2bf4f5bf74aa443491a04077.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi Outdoor',
 'transmission': 'manual',
 'trim': 'Outdoor',
 'year': 2018}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN63707%27 HTTP/1.1" 200 None
2026-01-28 17:05:20 [auto1.es] INFO: Saving data for FN63707: {'created_time': 1769619920.029382, 'last_price_update_time': 1769619920.029397, 'auction_closing_time': 1769703861.0}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN63707') HTTP/1.1" 204 0
2026-01-28 17:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP23605> (referer: https://www.auto1.com/v1/car-details-view/DP23605/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-01-28 17:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644, identifier: BT53297
2026-01-28 17:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2178df1e-db02-5cb0-b4ed-632171aa1b2d with identifier: BK72365
2026-01-28 17:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2178df1e-db02-5cb0-b4ed-632171aa1b2d with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2178df1e-db02-5cb0-b4ed-632171aa1b2d with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2178df1e-db02-5cb0-b4ed-632171aa1b2d, identifier: BK72365
2026-01-28 17:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343395f4-021e-5cc3-a655-55cc633938d4 with identifier: SF21345
2026-01-28 17:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343395f4-021e-5cc3-a655-55cc633938d4 with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343395f4-021e-5cc3-a655-55cc633938d4 with scrape type 2
2026-01-28 17:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 343395f4-021e-5cc3-a655-55cc633938d4, identifier: SF21345
2026-01-28 17:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-01-28 17:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297
2026-01-28 17:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dd5597b-f9ff-5c71-a6e1-53aaa0d51644 with identifier: BT53297 to the API
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BT53297>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:24:21Z',
 'fuel_type': 'diesel',
 'id': '0dd5597b-f9ff-5c71-a6e1-53aaa0d51644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT53297',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 126450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 Landmark Editon',
 'transmission': 'manual',
 'trim': 'Landmark Editon',
 'year': 2020}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BT53297%27 HTTP/1.1" 200 None
2026-01-28 17:05:20 [auto1.es] INFO: Saving data for BT53297: {'auction_closing_time': 1769703861.0, 'created_time': 1768237359.346292, 'last_price_update_time': 1769619920.704892}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BT53297') HTTP/1.1" 204 0
2026-01-28 17:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2178df1e-db02-5cb0-b4ed-632171aa1b2d with identifier: BK72365
2026-01-28 17:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2178df1e-db02-5cb0-b4ed-632171aa1b2d with identifier: BK72365
2026-01-28 17:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
2026-01-28 17:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2178df1e-db02-5cb0-b4ed-632171aa1b2d spider: auto1.es
2026-01-28 17:05:20 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2178df1e-db02-5cb0-b4ed-632171aa1b2d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'sprinter' containing 'sprinter'
{'auction_title': '',
 'c_o_2_emission_value': 242,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:04:50Z',
 'fuel_type': 'diesel',
 'id': '2178df1e-db02-5cb0-b4ed-632171aa1b2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK72365',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 9733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-03-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 315 CDI Kasten L2',
 'transmission': 'automatic',
 'trim': 'Kasten L2',
 'year': 2024}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK72365%27 HTTP/1.1" 200 None
2026-01-28 17:05:20 [auto1.es] INFO: Saving data for BK72365: {'auction_closing_time': 1769702690.0, 'created_time': 1769065309.704098, 'last_price_update_time': 1769619920.926462}
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK72365') HTTP/1.1" 204 0
2026-01-28 17:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 343395f4-021e-5cc3-a655-55cc633938d4 with identifier: SF21345
2026-01-28 17:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 343395f4-021e-5cc3-a655-55cc633938d4 with identifier: SF21345
2026-01-28 17:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
2026-01-28 17:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 343395f4-021e-5cc3-a655-55cc633938d4 spider: auto1.es
2026-01-28 17:05:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 343395f4-021e-5cc3-a655-55cc633938d4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumper' containing 'jumper'
{'auction_title': '',
 'c_o_2_emission_value': 229,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:35:45Z',
 'fuel_type': 'diesel',
 'id': '343395f4-021e-5cc3-a655-55cc633938d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF21345',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 122375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Jumper 2.2 Blue-HDi 28 L1H1 Control Start&Stop',
 'transmission': 'manual',
 'trim': '28 L1H1 Control Start&Stop',
 'year': 2021}
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SF21345%27 HTTP/1.1" 200 None
2026-01-28 17:05:21 [auto1.es] INFO: Saving data for SF21345: {'auction_closing_time': 1769704545.0, 'created_time': 1767978258.825169, 'last_price_update_time': 1769619921.173849}
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SF21345') HTTP/1.1" 204 0
2026-01-28 17:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e710c5-80e8-503f-ad0c-fe14b42692fb with identifier: DP23605
2026-01-28 17:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e710c5-80e8-503f-ad0c-fe14b42692fb with scrape type 2
2026-01-28 17:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4e710c5-80e8-503f-ad0c-fe14b42692fb with scrape type 2
2026-01-28 17:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e4e710c5-80e8-503f-ad0c-fe14b42692fb, identifier: DP23605
2026-01-28 17:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e4e710c5-80e8-503f-ad0c-fe14b42692fb with identifier: DP23605
2026-01-28 17:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e4e710c5-80e8-503f-ad0c-fe14b42692fb with identifier: DP23605
2026-01-28 17:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito tourer' containing 'vito'
2026-01-28 17:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: e4e710c5-80e8-503f-ad0c-fe14b42692fb spider: auto1.es
2026-01-28 17:05:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e4e710c5-80e8-503f-ad0c-fe14b42692fb due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'vito tourer' containing 'vito'
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:55:43Z',
 'fuel_type': 'diesel',
 'id': 'e4e710c5-80e8-503f-ad0c-fe14b42692fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP23605',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Vito Tourer',
 'odometer': 176832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Mercedes-Benz Vito Tourer 114 CDI Select lang',
 'transmission': 'automatic',
 'trim': 'Select lang',
 'year': 2020}
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DP23605%27 HTTP/1.1" 200 None
2026-01-28 17:05:21 [auto1.es] INFO: Saving data for DP23605: {'auction_closing_time': 1769705743.0, 'created_time': 1769447358.417432, 'last_price_update_time': 1769619921.510748}
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DP23605') HTTP/1.1" 204 0
2026-01-28 17:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YS21718/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH31906> (referer: https://www.auto1.com/v1/car-details-view/ZH31906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU80810> (referer: https://www.auto1.com/v1/car-details-view/BU80810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK36177> (referer: https://www.auto1.com/v1/car-details-view/BK36177/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CU45219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f12c2be-13e9-527b-a89a-fff5b013b28d with identifier: ZH31906
2026-01-28 17:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f12c2be-13e9-527b-a89a-fff5b013b28d with scrape type 1
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3f12c2be-13e9-527b-a89a-fff5b013b28d
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_fa43fbacaf5c949c3901b06beb093fd6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa43fbacaf5c949c3901b06beb093fd6.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_9f6a5667fe7f9d89ddb8e16d7a31fca7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_9f6a5667fe7f9d89ddb8e16d7a31fca7.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_d408891f2cc28092e9c09e5ca7e37473.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d408891f2cc28092e9c09e5ca7e37473.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_8e24538dd7775752966ca8a23e75bcc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_8e24538dd7775752966ca8a23e75bcc3.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_fc8124128682f2f91e31111b54033336.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fc8124128682f2f91e31111b54033336.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_fa5b11040fff2ea6b113f6e9836d0e0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa5b11040fff2ea6b113f6e9836d0e0e.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_d68ac56c1b34b97d17659297c72083fd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d68ac56c1b34b97d17659297c72083fd.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_6af00823de189b868d358ff77dc7064b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_6af00823de189b868d358ff77dc7064b.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_1078b35d8dfcb1f2f8d8a3784d67c7dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_1078b35d8dfcb1f2f8d8a3784d67c7dc.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_3cb96b44c301ecf2c90ab042bcc2edd9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_3cb96b44c301ecf2c90ab042bcc2edd9.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_f0c926a099473a2bf708ef058238f6b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_f0c926a099473a2bf708ef058238f6b7.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_baf7720f3dcfcc754f0f8dfd2ce31800.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_baf7720f3dcfcc754f0f8dfd2ce31800.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_238c20665d268cc9d0440c22c95a86dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_238c20665d268cc9d0440c22c95a86dd.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_b7484c1790f20b8e55f1ab3fb8001bcc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_b7484c1790f20b8e55f1ab3fb8001bcc.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_5201d867a09b473c1ce468639d05b65e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_5201d867a09b473c1ce468639d05b65e.jpg already downloaded
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F23%252F7f23c82bbb54bb9bc86b8a4e196ff669%252Fpa%252FZH31906_46e184811a7b86171db3b95159c18b4b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_46e184811a7b86171db3b95159c18b4b.jpg already downloaded
2026-01-28 17:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f12c2be-13e9-527b-a89a-fff5b013b28d, identifier: ZH31906
2026-01-28 17:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f12c2be-13e9-527b-a89a-fff5b013b28d with identifier: ZH31906
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f12c2be-13e9-527b-a89a-fff5b013b28d with identifier: ZH31906
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182918 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182918
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3f12c2be-13e9-527b-a89a-fff5b013b28d spider: auto1.es
2026-01-28 17:05:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3f12c2be-13e9-527b-a89a-fff5b013b28d due to rule: high_mileage_for_country.json, error: 182918 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182918
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:14:44Z',
 'fuel_type': 'diesel',
 'id': '3f12c2be-13e9-527b-a89a-fff5b013b28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH31906',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 182918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa43fbacaf5c949c3901b06beb093fd6.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_9f6a5667fe7f9d89ddb8e16d7a31fca7.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d408891f2cc28092e9c09e5ca7e37473.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_8e24538dd7775752966ca8a23e75bcc3.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fc8124128682f2f91e31111b54033336.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa5b11040fff2ea6b113f6e9836d0e0e.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d68ac56c1b34b97d17659297c72083fd.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_6af00823de189b868d358ff77dc7064b.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_1078b35d8dfcb1f2f8d8a3784d67c7dc.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_3cb96b44c301ecf2c90ab042bcc2edd9.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_f0c926a099473a2bf708ef058238f6b7.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_baf7720f3dcfcc754f0f8dfd2ce31800.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_238c20665d268cc9d0440c22c95a86dd.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_b7484c1790f20b8e55f1ab3fb8001bcc.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_5201d867a09b473c1ce468639d05b65e.jpg',
                'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_46e184811a7b86171db3b95159c18b4b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa43fbacaf5c949c3901b06beb093fd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_9f6a5667fe7f9d89ddb8e16d7a31fca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d408891f2cc28092e9c09e5ca7e37473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_8e24538dd7775752966ca8a23e75bcc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fc8124128682f2f91e31111b54033336.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_fa5b11040fff2ea6b113f6e9836d0e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_d68ac56c1b34b97d17659297c72083fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_6af00823de189b868d358ff77dc7064b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_1078b35d8dfcb1f2f8d8a3784d67c7dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_3cb96b44c301ecf2c90ab042bcc2edd9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_f0c926a099473a2bf708ef058238f6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_baf7720f3dcfcc754f0f8dfd2ce31800.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_238c20665d268cc9d0440c22c95a86dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_b7484c1790f20b8e55f1ab3fb8001bcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_5201d867a09b473c1ce468639d05b65e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f12c2be-13e9-527b-a89a-fff5b013b28d/3f12c2be-13e9-527b-a89a-fff5b013b28d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/23/7f23c82bbb54bb9bc86b8a4e196ff669/pa/ZH31906_46e184811a7b86171db3b95159c18b4b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi Style blue 2WD',
 'transmission': 'manual',
 'trim': 'Style blue 2WD',
 'year': 2017}
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZH31906%27 HTTP/1.1" 200 None
2026-01-28 17:05:22 [auto1.es] INFO: Saving data for ZH31906: {'created_time': 1769619922.770119, 'last_price_update_time': 1769619922.770131, 'auction_closing_time': 1769703284.0}
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZH31906') HTTP/1.1" 204 0
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU13655> (referer: https://www.auto1.com/v1/car-details-view/WU13655/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a344e64-d7e3-52ea-b502-4939afeb308a with identifier: BU80810
2026-01-28 17:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a344e64-d7e3-52ea-b502-4939afeb308a with scrape type 2
2026-01-28 17:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a344e64-d7e3-52ea-b502-4939afeb308a with scrape type 2
2026-01-28 17:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5a344e64-d7e3-52ea-b502-4939afeb308a, identifier: BU80810
2026-01-28 17:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XG14528> (referer: https://www.auto1.com/v1/car-details-view/XG14528/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV77036/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5a344e64-d7e3-52ea-b502-4939afeb308a with identifier: BU80810
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5a344e64-d7e3-52ea-b502-4939afeb308a with identifier: BU80810
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199826 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199826
2026-01-28 17:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5a344e64-d7e3-52ea-b502-4939afeb308a spider: auto1.es
2026-01-28 17:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5a344e64-d7e3-52ea-b502-4939afeb308a due to rule: high_mileage_for_country.json, error: 199826 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199826
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:24:50Z',
 'fuel_type': 'diesel',
 'id': '5a344e64-d7e3-52ea-b502-4939afeb308a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU80810',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 199826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2017}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BU80810%27 HTTP/1.1" 200 None
2026-01-28 17:05:23 [auto1.es] INFO: Saving data for BU80810: {'auction_closing_time': 1769703890.0, 'created_time': 1769003311.68047, 'last_price_update_time': 1769619923.107277}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BU80810') HTTP/1.1" 204 0
2026-01-28 17:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72dfac48-a8bd-56f4-949a-11a862183f97 with identifier: BK36177
2026-01-28 17:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72dfac48-a8bd-56f4-949a-11a862183f97 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72dfac48-a8bd-56f4-949a-11a862183f97 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72dfac48-a8bd-56f4-949a-11a862183f97, identifier: BK36177
2026-01-28 17:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH79865> (referer: https://www.auto1.com/v1/car-details-view/BH79865/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72dfac48-a8bd-56f4-949a-11a862183f97 with identifier: BK36177
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72dfac48-a8bd-56f4-949a-11a862183f97 with identifier: BK36177
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 72dfac48-a8bd-56f4-949a-11a862183f97 spider: auto1.es
2026-01-28 17:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 72dfac48-a8bd-56f4-949a-11a862183f97 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:15:35Z',
 'fuel_type': 'diesel',
 'id': '72dfac48-a8bd-56f4-949a-11a862183f97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK36177',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 100712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-07',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI L L3',
 'transmission': 'manual',
 'trim': 'L L3',
 'year': 2021}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BK36177%27 HTTP/1.1" 200 None
2026-01-28 17:05:23 [auto1.es] INFO: Saving data for BK36177: {'auction_closing_time': 1769703335.0, 'created_time': 1769447346.864501, 'last_price_update_time': 1769619923.430689}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BK36177') HTTP/1.1" 204 0
2026-01-28 17:05:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2026-01-28 17:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af551196-4131-5284-bb07-ea9e0bf03042 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af551196-4131-5284-bb07-ea9e0bf03042 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: af551196-4131-5284-bb07-ea9e0bf03042, identifier: WU13655
2026-01-28 17:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2026-01-28 17:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with scrape type 2
2026-01-28 17:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793, identifier: XG14528
2026-01-28 17:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: af551196-4131-5284-bb07-ea9e0bf03042 with identifier: WU13655
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: af551196-4131-5284-bb07-ea9e0bf03042 spider: auto1.es
2026-01-28 17:05:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: af551196-4131-5284-bb07-ea9e0bf03042 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:38:51Z',
 'fuel_type': 'diesel',
 'id': 'af551196-4131-5284-bb07-ea9e0bf03042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU13655',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 179968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU13655%27 HTTP/1.1" 200 None
2026-01-28 17:05:23 [auto1.es] INFO: Saving data for WU13655: {'auction_closing_time': 1769704731.0, 'created_time': 1769061738.873996, 'last_price_update_time': 1769619923.826379}
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU13655') HTTP/1.1" 204 0
2026-01-28 17:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 with identifier: XG14528
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 spider: auto1.es
2026-01-28 17:05:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9fc13fd7-cd6d-558a-9f2d-b3e1583b3793 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:32:17Z',
 'fuel_type': 'diesel',
 'id': '9fc13fd7-cd6d-558a-9f2d-b3e1583b3793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG14528',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 195835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Access L1',
 'transmission': 'manual',
 'trim': 'Access L1',
 'year': 2020}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XG14528%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Saving data for XG14528: {'auction_closing_time': 1769704337.0, 'created_time': 1768237618.769486, 'last_price_update_time': 1769619924.06058}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XG14528') HTTP/1.1" 204 0
2026-01-28 17:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2026-01-28 17:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68058d47-5081-5ad6-94b6-8fb66f19905a with scrape type 2
2026-01-28 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68058d47-5081-5ad6-94b6-8fb66f19905a with scrape type 2
2026-01-28 17:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 68058d47-5081-5ad6-94b6-8fb66f19905a, identifier: BH79865
2026-01-28 17:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 68058d47-5081-5ad6-94b6-8fb66f19905a with identifier: BH79865
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 164505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164505
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 68058d47-5081-5ad6-94b6-8fb66f19905a spider: auto1.es
2026-01-28 17:05:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 68058d47-5081-5ad6-94b6-8fb66f19905a due to rule: high_mileage_for_country.json, error: 164505 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    164505
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:37:57Z',
 'fuel_type': 'hybrid',
 'id': '68058d47-5081-5ad6-94b6-8fb66f19905a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH79865',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 164505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2021}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH79865%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Saving data for BH79865: {'auction_closing_time': 1769704677.0, 'created_time': 1768237398.378868, 'last_price_update_time': 1769619924.388209}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BH79865') HTTP/1.1" 204 0
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF63413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT87385/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ58793> (referer: https://www.auto1.com/v1/car-details-view/WJ58793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: RD19726
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RD19726%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for RD19726: 0
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: NS82424
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS82424%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for NS82424: 2
2026-01-28 17:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd4bee40-6acf-5d12-ac27-95b909e6d657 with identifier: WJ58793
2026-01-28 17:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd4bee40-6acf-5d12-ac27-95b909e6d657 with scrape type 2
2026-01-28 17:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd4bee40-6acf-5d12-ac27-95b909e6d657 with scrape type 2
2026-01-28 17:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bd4bee40-6acf-5d12-ac27-95b909e6d657, identifier: WJ58793
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: YG61105
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG61105%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for YG61105: 2
2026-01-28 17:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bd4bee40-6acf-5d12-ac27-95b909e6d657 with identifier: WJ58793
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bd4bee40-6acf-5d12-ac27-95b909e6d657 with identifier: WJ58793
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 191188 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191188
2026-01-28 17:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bd4bee40-6acf-5d12-ac27-95b909e6d657 spider: auto1.es
2026-01-28 17:05:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bd4bee40-6acf-5d12-ac27-95b909e6d657 due to rule: high_mileage_for_country.json, error: 191188 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    191188
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:06:23Z',
 'fuel_type': 'diesel',
 'id': 'bd4bee40-6acf-5d12-ac27-95b909e6d657',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ58793',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 191188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2022}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ58793%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Saving data for WJ58793: {'auction_closing_time': 1769702783.0, 'created_time': 1769061739.149471, 'last_price_update_time': 1769619924.910978}
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ58793') HTTP/1.1" 204 0
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: DL02134
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL02134%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for DL02134: 2
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE01267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX51290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: KT38971
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for KT38971: 2
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: ZL71949
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL71949%27 HTTP/1.1" 200 None
2026-01-28 17:05:24 [auto1.es] INFO: Scrape type for ZL71949: 2
2026-01-28 17:05:24 [auto1.es] INFO: Found listing with ID: LF74098
2026-01-28 17:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF74098%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for LF74098: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: BV41584
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV41584%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for BV41584: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: HY44668
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY44668%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for HY44668: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: HK65705
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for HK65705: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: CH32569
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH32569%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for CH32569: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: RK21190
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for RK21190: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: KF67108
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for KF67108: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: ZL07637
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL07637%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for ZL07637: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: BD74245
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD74245%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for BD74245: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: DG13675
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13675%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for DG13675: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: TB59452
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for TB59452: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: DL66234
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL66234%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for DL66234: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: LW49246
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW49246%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for LW49246: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: JS12775
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS12775%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for JS12775: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: VX60212
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX60212%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for VX60212: 1
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: XR29663
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29663%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for XR29663: 1
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: DH09683
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH09683%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for DH09683: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: TK40804
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK40804%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for TK40804: 1
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: DH75586
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75586%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for DH75586: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: EA12366
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA12366%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for EA12366: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: BP57031
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for BP57031: 2
2026-01-28 17:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG09681> (referer: https://www.auto1.com/v1/car-details-view/MG09681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: YN21333
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN21333%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for YN21333: 2
2026-01-28 17:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: BE67955
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE67955%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for BE67955: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: BJ79125
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ79125%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for BJ79125: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: DE51179
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51179%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for DE51179: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: WU52604
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU52604%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for WU52604: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: XZ62505
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62505%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for XZ62505: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: FV98550
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for FV98550: 2
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: FU11431
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU11431%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for FU11431: 1
2026-01-28 17:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 with identifier: MG09681
2026-01-28 17:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 with scrape type 2
2026-01-28 17:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 with scrape type 2
2026-01-28 17:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80, identifier: MG09681
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: HL64379
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL64379%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Scrape type for HL64379: 2
2026-01-28 17:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 with identifier: MG09681
2026-01-28 17:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 with identifier: MG09681
2026-01-28 17:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
2026-01-28 17:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 spider: auto1.es
2026-01-28 17:05:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8e8c11d1-208e-5c0d-87b4-c02db76f8f80 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'iveco' containing 'iveco' and model 'daily' containing 'daily'
{'auction_title': '',
 'c_o_2_emission_value': 230,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 155,
 'expiration_date': '2026-01-29T16:46:11Z',
 'fuel_type': 'diesel',
 'id': '8e8c11d1-208e-5c0d-87b4-c02db76f8f80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG09681',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Iveco',
 'model': 'Daily',
 'odometer': 87743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 3520 L',
 'transmission': 'manual',
 'trim': 'HKa 35 S V Radstand 3520 L',
 'year': 2023}
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG09681%27 HTTP/1.1" 200 None
2026-01-28 17:05:25 [auto1.es] INFO: Saving data for MG09681: {'auction_closing_time': 1769705171.0, 'created_time': 1769447021.134356, 'last_price_update_time': 1769619925.848205}
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG09681') HTTP/1.1" 204 0
2026-01-28 17:05:25 [auto1.es] INFO: Found listing with ID: MP30074
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP30074%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Scrape type for MP30074: 2
2026-01-28 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC75424> (referer: https://www.auto1.com/v1/car-details-view/TC75424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV50071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH83522> (referer: https://www.auto1.com/v1/car-details-view/BH83522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP81684> (referer: https://www.auto1.com/v1/car-details-view/LP81684/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:26 [auto1.es] INFO: Found listing with ID: WJ13616
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13616%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Scrape type for WJ13616: 2
2026-01-28 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:26 [auto1.es] INFO: Found listing with ID: GL43713
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL43713%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Scrape type for GL43713: 1
2026-01-28 17:05:26 [auto1.es] INFO: Found listing with ID: DY55894
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Scrape type for DY55894: 2
2026-01-28 17:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV01801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b19ef8d8-3037-5764-804d-dfbe6b459c5e with identifier: TC75424
2026-01-28 17:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b19ef8d8-3037-5764-804d-dfbe6b459c5e with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b19ef8d8-3037-5764-804d-dfbe6b459c5e with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b19ef8d8-3037-5764-804d-dfbe6b459c5e, identifier: TC75424
2026-01-28 17:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b19ef8d8-3037-5764-804d-dfbe6b459c5e with identifier: TC75424
2026-01-28 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b19ef8d8-3037-5764-804d-dfbe6b459c5e with identifier: TC75424
2026-01-28 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189906 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189906
2026-01-28 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b19ef8d8-3037-5764-804d-dfbe6b459c5e spider: auto1.es
2026-01-28 17:05:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b19ef8d8-3037-5764-804d-dfbe6b459c5e due to rule: high_mileage_for_country.json, error: 189906 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189906
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:26:35Z',
 'fuel_type': 'petrol',
 'id': 'b19ef8d8-3037-5764-804d-dfbe6b459c5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC75424',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 189906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2021}
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC75424%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Saving data for TC75424: {'auction_closing_time': 1769703995.0, 'created_time': 1767938584.408521, 'last_price_update_time': 1769619926.421468}
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TC75424') HTTP/1.1" 204 0
2026-01-28 17:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with identifier: BH83522
2026-01-28 17:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 446ad2cc-9c79-52cd-9065-8aeb6abbec79, identifier: BH83522
2026-01-28 17:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2026-01-28 17:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60bd97d5-501d-52c9-a969-64ec73d7bb35 with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60bd97d5-501d-52c9-a969-64ec73d7bb35 with scrape type 2
2026-01-28 17:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 60bd97d5-501d-52c9-a969-64ec73d7bb35, identifier: LP81684
2026-01-28 17:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with identifier: BH83522
2026-01-28 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with identifier: BH83522
2026-01-28 17:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 446ad2cc-9c79-52cd-9065-8aeb6abbec79 with identifier: BH83522 to the API
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BH83522>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:50:46Z',
 'fuel_type': 'petrol',
 'id': '446ad2cc-9c79-52cd-9065-8aeb6abbec79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH83522',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 72186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BH83522%27 HTTP/1.1" 200 None
2026-01-28 17:05:26 [auto1.es] INFO: Saving data for BH83522: {'auction_closing_time': 1769705446.0, 'created_time': 1767619758.17342, 'last_price_update_time': 1769619926.962254}
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BH83522') HTTP/1.1" 204 0
2026-01-28 17:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2026-01-28 17:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684
2026-01-28 17:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 60bd97d5-501d-52c9-a969-64ec73d7bb35 with identifier: LP81684 to the API
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP81684>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:11:02Z',
 'fuel_type': 'diesel',
 'id': '60bd97d5-501d-52c9-a969-64ec73d7bb35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP81684',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 145355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP81684%27 HTTP/1.1" 200 None
2026-01-28 17:05:27 [auto1.es] INFO: Saving data for LP81684: {'auction_closing_time': 1769703062.0, 'created_time': 1768237366.33238, 'last_price_update_time': 1769619927.742171}
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP81684') HTTP/1.1" 204 0
2026-01-28 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM12351/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YS21718> (referer: https://www.auto1.com/v1/car-details-view/YS21718/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with identifier: YS21718
2026-01-28 17:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with scrape type 2
2026-01-28 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with scrape type 2
2026-01-28 17:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac, identifier: YS21718
2026-01-28 17:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with identifier: YS21718
2026-01-28 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with identifier: YS21718
2026-01-28 17:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6b3d6ecf-59b5-56c5-8c8c-69991fb611ac with identifier: YS21718 to the API
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YS21718>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:43:12Z',
 'fuel_type': 'diesel',
 'id': '6b3d6ecf-59b5-56c5-8c8c-69991fb611ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS21718',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 25296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YS21718%27 HTTP/1.1" 200 None
2026-01-28 17:05:28 [auto1.es] INFO: Saving data for YS21718: {'auction_closing_time': 1769704992.0, 'created_time': 1769101273.286062, 'last_price_update_time': 1769619928.425145}
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YS21718') HTTP/1.1" 204 0
2026-01-28 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR87583/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF56333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU45219> (referer: https://www.auto1.com/v1/car-details-view/CU45219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL02134/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV77036> (referer: https://www.auto1.com/v1/car-details-view/CV77036/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07315aa5-3fba-5844-9b03-0f0938f0ef90 with identifier: CU45219
2026-01-28 17:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07315aa5-3fba-5844-9b03-0f0938f0ef90 with scrape type 2
2026-01-28 17:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07315aa5-3fba-5844-9b03-0f0938f0ef90 with scrape type 2
2026-01-28 17:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 07315aa5-3fba-5844-9b03-0f0938f0ef90, identifier: CU45219
2026-01-28 17:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 07315aa5-3fba-5844-9b03-0f0938f0ef90 with identifier: CU45219
2026-01-28 17:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 07315aa5-3fba-5844-9b03-0f0938f0ef90 with identifier: CU45219
2026-01-28 17:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 07315aa5-3fba-5844-9b03-0f0938f0ef90 with identifier: CU45219 to the API
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU45219>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:23:11Z',
 'fuel_type': 'petrol',
 'id': '07315aa5-3fba-5844-9b03-0f0938f0ef90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU45219',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 67293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Selective Start/Stop',
 'transmission': 'manual',
 'trim': 'Selective Start/Stop',
 'year': 2018}
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU45219%27 HTTP/1.1" 200 None
2026-01-28 17:05:29 [auto1.es] INFO: Saving data for CU45219: {'auction_closing_time': 1769703791.0, 'created_time': 1769003389.750038, 'last_price_update_time': 1769619929.095453}
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CU45219') HTTP/1.1" 204 0
2026-01-28 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK42155/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8d51158-7218-549f-bf52-601fb41277af with identifier: CV77036
2026-01-28 17:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8d51158-7218-549f-bf52-601fb41277af with scrape type 2
2026-01-28 17:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8d51158-7218-549f-bf52-601fb41277af with scrape type 2
2026-01-28 17:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c8d51158-7218-549f-bf52-601fb41277af, identifier: CV77036
2026-01-28 17:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c8d51158-7218-549f-bf52-601fb41277af with identifier: CV77036
2026-01-28 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c8d51158-7218-549f-bf52-601fb41277af with identifier: CV77036
2026-01-28 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 72868, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cv77036', 'expiration_date': '2026-01-29t16:56:17z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, pedrola, zaragoza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'c8d51158-7218-549f-bf52-601fb41277af', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 72868}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:56:17z',
     'fuel_type': 'petrol',
     'id': 'c8d51158-7218-549f-bf52-601fb41277af',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cv77036',
     'listing': 'auction',
     'location': 'es, pedrola, zaragoza',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 72868,
     'odometer_in_km': 72868,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
2026-01-28 17:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c8d51158-7218-549f-bf52-601fb41277af spider: auto1.es
2026-01-28 17:05:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c8d51158-7218-549f-bf52-601fb41277af due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'orange', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 72868, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-30', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cv77036', 'expiration_date': '2026-01-29t16:56:17z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, pedrola, zaragoza', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'c8d51158-7218-549f-bf52-601fb41277af', 'current_year_diff': 6, 'age_in_months': 63, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 72868}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 63,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'orange',
     'currency': 'eur',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:56:17z',
     'fuel_type': 'petrol',
     'id': 'c8d51158-7218-549f-bf52-601fb41277af',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/cv77036',
     'listing': 'auction',
     'location': 'es, pedrola, zaragoza',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 72868,
     'odometer_in_km': 72868,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2020-09-30',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:56:17Z',
 'fuel_type': 'petrol',
 'id': 'c8d51158-7218-549f-bf52-601fb41277af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV77036',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 72868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV77036%27 HTTP/1.1" 200 None
2026-01-28 17:05:29 [auto1.es] INFO: Saving data for CV77036: {'auction_closing_time': 1769705777.0, 'created_time': 1764090298.011524, 'last_price_update_time': 1769619929.435353}
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV77036') HTTP/1.1" 204 0
2026-01-28 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YG61105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV01854/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP57031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MP30074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV98550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL64379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY55894/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU11431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV50071> (referer: https://www.auto1.com/v1/car-details-view/EV50071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV01801> (referer: https://www.auto1.com/v1/car-details-view/AV01801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cea6499e-ddcb-51d7-b278-e40fb0c989ce with identifier: EV50071
2026-01-28 17:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cea6499e-ddcb-51d7-b278-e40fb0c989ce with scrape type 2
2026-01-28 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cea6499e-ddcb-51d7-b278-e40fb0c989ce with scrape type 2
2026-01-28 17:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cea6499e-ddcb-51d7-b278-e40fb0c989ce, identifier: EV50071
2026-01-28 17:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cea6499e-ddcb-51d7-b278-e40fb0c989ce with identifier: EV50071
2026-01-28 17:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cea6499e-ddcb-51d7-b278-e40fb0c989ce with identifier: EV50071
2026-01-28 17:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cea6499e-ddcb-51d7-b278-e40fb0c989ce spider: auto1.es
2026-01-28 17:05:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cea6499e-ddcb-51d7-b278-e40fb0c989ce due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:17:16Z',
 'fuel_type': 'diesel',
 'id': 'cea6499e-ddcb-51d7-b278-e40fb0c989ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV50071',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 153313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2021}
2026-01-28 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV50071%27 HTTP/1.1" 200 None
2026-01-28 17:05:30 [auto1.es] INFO: Saving data for EV50071: {'auction_closing_time': 1769703436.0, 'created_time': 1769101654.179929, 'last_price_update_time': 1769619930.960811}
2026-01-28 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EV50071') HTTP/1.1" 204 0
2026-01-28 17:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL43713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047e4931-5f82-55cb-902b-6f356cdb1a86 with identifier: AV01801
2026-01-28 17:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047e4931-5f82-55cb-902b-6f356cdb1a86 with scrape type 2
2026-01-28 17:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 047e4931-5f82-55cb-902b-6f356cdb1a86 with scrape type 2
2026-01-28 17:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 047e4931-5f82-55cb-902b-6f356cdb1a86, identifier: AV01801
2026-01-28 17:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 047e4931-5f82-55cb-902b-6f356cdb1a86 with identifier: AV01801
2026-01-28 17:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 047e4931-5f82-55cb-902b-6f356cdb1a86 with identifier: AV01801
2026-01-28 17:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 047e4931-5f82-55cb-902b-6f356cdb1a86 with identifier: AV01801 to the API
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AV01801>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:44:16Z',
 'fuel_type': 'petrol',
 'id': '047e4931-5f82-55cb-902b-6f356cdb1a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV01801',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 103910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Sport FWD',
 'transmission': 'manual',
 'trim': 'Sport FWD',
 'year': 2018}
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV01801%27 HTTP/1.1" 200 None
2026-01-28 17:05:31 [auto1.es] INFO: Saving data for AV01801: {'auction_closing_time': 1769705056.0, 'created_time': 1767872270.00541, 'last_price_update_time': 1769619931.759684}
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV01801') HTTP/1.1" 204 0
2026-01-28 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF56333> (referer: https://www.auto1.com/v1/car-details-view/YF56333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR87583> (referer: https://www.auto1.com/v1/car-details-view/PR87583/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb95b12-5b45-532b-86d4-97c0c6f50619 with identifier: YF56333
2026-01-28 17:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb95b12-5b45-532b-86d4-97c0c6f50619 with scrape type 2
2026-01-28 17:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb95b12-5b45-532b-86d4-97c0c6f50619 with scrape type 2
2026-01-28 17:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: acb95b12-5b45-532b-86d4-97c0c6f50619, identifier: YF56333
2026-01-28 17:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a94702a-f42a-5ef2-aa83-0ac93821e98f with identifier: PR87583
2026-01-28 17:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a94702a-f42a-5ef2-aa83-0ac93821e98f with scrape type 1
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 17 photos for item 8a94702a-f42a-5ef2-aa83-0ac93821e98f
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_460e1f848e22b566395e6fd907ff4ed2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_460e1f848e22b566395e6fd907ff4ed2.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_4d878cb7a103e9a3cd55e772d5ab23f4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_4d878cb7a103e9a3cd55e772d5ab23f4.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_3853fc40a5771775770e12ef2f55589f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_3853fc40a5771775770e12ef2f55589f.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_20e3a91d684da793bd5c4c0085c8d58e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_20e3a91d684da793bd5c4c0085c8d58e.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_ded19272b902b275be2c8cc0ee6a2769.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_ded19272b902b275be2c8cc0ee6a2769.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_1bffa46f0654fae009aac98185f71f6c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_1bffa46f0654fae009aac98185f71f6c.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_949754cf918bbffaa58dfcb047a99703.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_949754cf918bbffaa58dfcb047a99703.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_d4f73aab98ba570b603ec5a397da8f74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_d4f73aab98ba570b603ec5a397da8f74.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_b4868f19c988f8337fa6cc33c22fabd2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_b4868f19c988f8337fa6cc33c22fabd2.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_bdc763cef848b1051d0bef274a8aeabe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_bdc763cef848b1051d0bef274a8aeabe.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_7c8fb60af55d7dbdfdd63f093484cf93.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_7c8fb60af55d7dbdfdd63f093484cf93.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_2d5c53b4053febe0c0989f52fa26b5b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_2d5c53b4053febe0c0989f52fa26b5b6.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_439779618626f5298f6d88ed162845b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_439779618626f5298f6d88ed162845b5.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_cae688aeb836e8b48d994ae739f0e37c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_cae688aeb836e8b48d994ae739f0e37c.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_e853fc6622dabd135d1f9b302ff472c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_e853fc6622dabd135d1f9b302ff472c1.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_716128d2973bf87ec9255cef87b917fd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_716128d2973bf87ec9255cef87b917fd.jpg already downloaded
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fc9%252Facc9914a2dbc6831b337e12f2d8a06a5%252Fpa%252FPR87583_77f500d45debf870be3fa0b335262ac9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_77f500d45debf870be3fa0b335262ac9.jpg already downloaded
2026-01-28 17:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a94702a-f42a-5ef2-aa83-0ac93821e98f, identifier: PR87583
2026-01-28 17:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: acb95b12-5b45-532b-86d4-97c0c6f50619 with identifier: YF56333
2026-01-28 17:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: acb95b12-5b45-532b-86d4-97c0c6f50619 with identifier: YF56333
2026-01-28 17:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: acb95b12-5b45-532b-86d4-97c0c6f50619 with identifier: YF56333 to the API
2026-01-28 17:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YF56333>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2026-01-29T16:22:01Z',
 'fuel_type': 'hybrid',
 'id': 'acb95b12-5b45-532b-86d4-97c0c6f50619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF56333',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '7er',
 'odometer': 131439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 745e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YF56333%27 HTTP/1.1" 200 None
2026-01-28 17:05:33 [auto1.es] INFO: Saving data for YF56333: {'auction_closing_time': 1769703721.0, 'created_time': 1767703540.373456, 'last_price_update_time': 1769619933.740083}
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YF56333') HTTP/1.1" 204 0
2026-01-28 17:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a94702a-f42a-5ef2-aa83-0ac93821e98f with identifier: PR87583
2026-01-28 17:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a94702a-f42a-5ef2-aa83-0ac93821e98f with identifier: PR87583
2026-01-28 17:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8a94702a-f42a-5ef2-aa83-0ac93821e98f with identifier: PR87583 to the API
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PR87583>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:24:14Z',
 'fuel_type': 'petrol',
 'id': '8a94702a-f42a-5ef2-aa83-0ac93821e98f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR87583',
 'listing': 'auction',
 'location': 'ES, MÁLAGA',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 50537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 17,
 'photo_urls': ['https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_460e1f848e22b566395e6fd907ff4ed2.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_4d878cb7a103e9a3cd55e772d5ab23f4.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_3853fc40a5771775770e12ef2f55589f.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_20e3a91d684da793bd5c4c0085c8d58e.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_ded19272b902b275be2c8cc0ee6a2769.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_1bffa46f0654fae009aac98185f71f6c.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_949754cf918bbffaa58dfcb047a99703.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_d4f73aab98ba570b603ec5a397da8f74.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_b4868f19c988f8337fa6cc33c22fabd2.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_bdc763cef848b1051d0bef274a8aeabe.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_7c8fb60af55d7dbdfdd63f093484cf93.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_2d5c53b4053febe0c0989f52fa26b5b6.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_439779618626f5298f6d88ed162845b5.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_cae688aeb836e8b48d994ae739f0e37c.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_e853fc6622dabd135d1f9b302ff472c1.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_716128d2973bf87ec9255cef87b917fd.jpg',
                'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_77f500d45debf870be3fa0b335262ac9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_460e1f848e22b566395e6fd907ff4ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_4d878cb7a103e9a3cd55e772d5ab23f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_3853fc40a5771775770e12ef2f55589f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_20e3a91d684da793bd5c4c0085c8d58e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_ded19272b902b275be2c8cc0ee6a2769.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_1bffa46f0654fae009aac98185f71f6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_949754cf918bbffaa58dfcb047a99703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_d4f73aab98ba570b603ec5a397da8f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_b4868f19c988f8337fa6cc33c22fabd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_bdc763cef848b1051d0bef274a8aeabe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_7c8fb60af55d7dbdfdd63f093484cf93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_2d5c53b4053febe0c0989f52fa26b5b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_439779618626f5298f6d88ed162845b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_cae688aeb836e8b48d994ae739f0e37c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_e853fc6622dabd135d1f9b302ff472c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_716128d2973bf87ec9255cef87b917fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a94702a-f42a-5ef2-aa83-0ac93821e98f/8a94702a-f42a-5ef2-aa83-0ac93821e98f_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/c9/acc9914a2dbc6831b337e12f2d8a06a5/pa/PR87583_77f500d45debf870be3fa0b335262ac9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PR87583%27 HTTP/1.1" 200 None
2026-01-28 17:05:34 [auto1.es] INFO: Saving data for PR87583: {'created_time': 1769619934.06806, 'last_price_update_time': 1769619934.06807, 'auction_closing_time': 1769703854.0}
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PR87583') HTTP/1.1" 204 0
2026-01-28 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU52604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM12351> (referer: https://www.auto1.com/v1/car-details-view/XM12351/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL02134> (referer: https://www.auto1.com/v1/car-details-view/DL02134/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ13616/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2026-01-28 17:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad57214b-f134-5eba-96f9-7f369c8d7236 with scrape type 2
2026-01-28 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad57214b-f134-5eba-96f9-7f369c8d7236 with scrape type 2
2026-01-28 17:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad57214b-f134-5eba-96f9-7f369c8d7236, identifier: XM12351
2026-01-28 17:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2026-01-28 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351
2026-01-28 17:05:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad57214b-f134-5eba-96f9-7f369c8d7236 with identifier: XM12351 to the API
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XM12351>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:37:48Z',
 'fuel_type': 'diesel',
 'id': 'ad57214b-f134-5eba-96f9-7f369c8d7236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XM12351',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 148408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XM12351%27 HTTP/1.1" 200 None
2026-01-28 17:05:34 [auto1.es] INFO: Saving data for XM12351: {'auction_closing_time': 1769704668.0, 'created_time': 1768237364.765895, 'last_price_update_time': 1769619934.59549}
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XM12351') HTTP/1.1" 204 0
2026-01-28 17:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2026-01-28 17:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29645b1e-499c-5271-86d9-b6b9a0bb920a with scrape type 2
2026-01-28 17:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29645b1e-499c-5271-86d9-b6b9a0bb920a with scrape type 2
2026-01-28 17:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29645b1e-499c-5271-86d9-b6b9a0bb920a, identifier: DL02134
2026-01-28 17:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE51179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2026-01-28 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29645b1e-499c-5271-86d9-b6b9a0bb920a with identifier: DL02134
2026-01-28 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168828 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168828
2026-01-28 17:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 29645b1e-499c-5271-86d9-b6b9a0bb920a spider: auto1.es
2026-01-28 17:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 29645b1e-499c-5271-86d9-b6b9a0bb920a due to rule: high_mileage_for_country.json, error: 168828 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168828
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 299,
 'expiration_date': '2026-01-29T16:00:54Z',
 'fuel_type': 'hybrid',
 'id': '29645b1e-499c-5271-86d9-b6b9a0bb920a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL02134',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 168828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL02134%27 HTTP/1.1" 200 None
2026-01-28 17:05:35 [auto1.es] INFO: Saving data for DL02134: {'auction_closing_time': 1769702454.0, 'created_time': 1768237327.673347, 'last_price_update_time': 1769619935.025231}
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL02134') HTTP/1.1" 204 0
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP57031> (referer: https://www.auto1.com/v1/car-details-view/BP57031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV01854> (referer: https://www.auto1.com/v1/car-details-view/CV01854/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-01-28 17:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with scrape type 2
2026-01-28 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with scrape type 2
2026-01-28 17:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7a01c8d-a7a3-512b-9f7e-612a0231dca2, identifier: BP57031
2026-01-28 17:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-01-28 17:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 with identifier: BP57031
2026-01-28 17:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 138642 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    138642
2026-01-28 17:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 spider: auto1.es
2026-01-28 17:05:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e7a01c8d-a7a3-512b-9f7e-612a0231dca2 due to rule: high_mileage_for_make.json, error: 138642 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    138642
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:57:12Z',
 'fuel_type': 'diesel',
 'id': 'e7a01c8d-a7a3-512b-9f7e-612a0231dca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP57031',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 138642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP57031%27 HTTP/1.1" 200 None
2026-01-28 17:05:35 [auto1.es] INFO: Saving data for BP57031: {'auction_closing_time': 1769705832.0, 'created_time': 1768410212.862143, 'last_price_update_time': 1769619935.859374}
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP57031') HTTP/1.1" 204 0
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MP30074> (referer: https://www.auto1.com/v1/car-details-view/MP30074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK42155> (referer: https://www.auto1.com/v1/car-details-view/NK42155/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY55894> (referer: https://www.auto1.com/v1/car-details-view/DY55894/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YG61105> (referer: https://www.auto1.com/v1/car-details-view/YG61105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-01-28 17:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2026-01-28 17:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dab811f-8fdc-55f4-8aea-8196cd84998d with scrape type 2
2026-01-28 17:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7dab811f-8fdc-55f4-8aea-8196cd84998d, identifier: CV01854
2026-01-28 17:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-01-28 17:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7dab811f-8fdc-55f4-8aea-8196cd84998d with identifier: CV01854
2026-01-28 17:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172539
2026-01-28 17:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7dab811f-8fdc-55f4-8aea-8196cd84998d spider: auto1.es
2026-01-28 17:05:36 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7dab811f-8fdc-55f4-8aea-8196cd84998d due to rule: high_mileage_for_country.json, error: 172539 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172539
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:41:29Z',
 'fuel_type': 'diesel',
 'id': '7dab811f-8fdc-55f4-8aea-8196cd84998d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV01854',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '2er',
 'odometer': 172539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 2er 216d Gran Tourer',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV01854%27 HTTP/1.1" 200 None
2026-01-28 17:05:36 [auto1.es] INFO: Saving data for CV01854: {'auction_closing_time': 1769704889.0, 'created_time': 1768237367.900819, 'last_price_update_time': 1769619936.207963}
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV01854') HTTP/1.1" 204 0
2026-01-28 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU11431> (referer: https://www.auto1.com/v1/car-details-view/FU11431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL64379> (referer: https://www.auto1.com/v1/car-details-view/HL64379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9866d2fa-0157-5148-bb75-73d1b11f6084 with identifier: MP30074
2026-01-28 17:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9866d2fa-0157-5148-bb75-73d1b11f6084 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9866d2fa-0157-5148-bb75-73d1b11f6084 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9866d2fa-0157-5148-bb75-73d1b11f6084, identifier: MP30074
2026-01-28 17:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with identifier: NK42155
2026-01-28 17:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8, identifier: NK42155
2026-01-28 17:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-01-28 17:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc0894b5-71d2-5307-9319-a507c4910562 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc0894b5-71d2-5307-9319-a507c4910562 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dc0894b5-71d2-5307-9319-a507c4910562, identifier: DY55894
2026-01-28 17:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa77c14-eb54-52aa-a0b5-01263bba3958 with identifier: YG61105
2026-01-28 17:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa77c14-eb54-52aa-a0b5-01263bba3958 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8aa77c14-eb54-52aa-a0b5-01263bba3958 with scrape type 2
2026-01-28 17:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8aa77c14-eb54-52aa-a0b5-01263bba3958, identifier: YG61105
2026-01-28 17:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9866d2fa-0157-5148-bb75-73d1b11f6084 with identifier: MP30074
2026-01-28 17:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9866d2fa-0157-5148-bb75-73d1b11f6084 with identifier: MP30074
2026-01-28 17:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9866d2fa-0157-5148-bb75-73d1b11f6084 with identifier: MP30074 to the API
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MP30074>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:24:21Z',
 'fuel_type': 'diesel',
 'id': '9866d2fa-0157-5148-bb75-73d1b11f6084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP30074',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 53533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MP30074%27 HTTP/1.1" 200 None
2026-01-28 17:05:36 [auto1.es] INFO: Saving data for MP30074: {'auction_closing_time': 1769703861.0, 'created_time': 1767780121.971392, 'last_price_update_time': 1769619936.963704}
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MP30074') HTTP/1.1" 204 0
2026-01-28 17:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with identifier: NK42155
2026-01-28 17:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with identifier: NK42155
2026-01-28 17:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8 with identifier: NK42155 to the API
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK42155>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:41:28Z',
 'fuel_type': 'diesel',
 'id': 'bc50ffdc-31b2-5655-ac5a-ccb9d3bf6ca8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK42155',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 81516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK42155%27 HTTP/1.1" 200 None
2026-01-28 17:05:37 [auto1.es] INFO: Saving data for NK42155: {'auction_closing_time': 1769704888.0, 'created_time': 1768237423.012482, 'last_price_update_time': 1769619937.250992}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NK42155') HTTP/1.1" 204 0
2026-01-28 17:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-01-28 17:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894
2026-01-28 17:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dc0894b5-71d2-5307-9319-a507c4910562 with identifier: DY55894 to the API
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DY55894>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:32:06Z',
 'fuel_type': 'diesel',
 'id': 'dc0894b5-71d2-5307-9319-a507c4910562',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY55894',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 146055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2020}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY55894%27 HTTP/1.1" 200 None
2026-01-28 17:05:37 [auto1.es] INFO: Saving data for DY55894: {'auction_closing_time': 1769704326.0, 'created_time': 1768323700.231377, 'last_price_update_time': 1769619937.587025}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY55894') HTTP/1.1" 204 0
2026-01-28 17:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8aa77c14-eb54-52aa-a0b5-01263bba3958 with identifier: YG61105
2026-01-28 17:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8aa77c14-eb54-52aa-a0b5-01263bba3958 with identifier: YG61105
2026-01-28 17:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8aa77c14-eb54-52aa-a0b5-01263bba3958 with identifier: YG61105 to the API
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YG61105>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:39:54Z',
 'fuel_type': 'diesel',
 'id': '8aa77c14-eb54-52aa-a0b5-01263bba3958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG61105',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 81169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YG61105%27 HTTP/1.1" 200 None
2026-01-28 17:05:37 [auto1.es] INFO: Saving data for YG61105: {'auction_closing_time': 1769704794.0, 'created_time': 1769148132.983604, 'last_price_update_time': 1769619937.890247}
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YG61105') HTTP/1.1" 204 0
2026-01-28 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ79125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV98550> (referer: https://www.auto1.com/v1/car-details-view/FV98550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1ec88c-4196-5a8f-a986-f33a1257ae30 with identifier: FU11431
2026-01-28 17:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30 with scrape type 1
2026-01-28 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_7e7273542b481e04c966d41ec177bfb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7e7273542b481e04c966d41ec177bfb4.jpg not downloaded yet
2026-01-28 17:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa with identifier: HL64379
2026-01-28 17:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa with scrape type 2
2026-01-28 17:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa with scrape type 2
2026-01-28 17:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa, identifier: HL64379
2026-01-28 17:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa with identifier: HL64379
2026-01-28 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa with identifier: HL64379
2026-01-28 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
2026-01-28 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa spider: auto1.es
2026-01-28 17:05:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6bb40336-50d0-54d4-b60b-ad3ddef7d6aa due to rule: makes_models_not_allowed.json, error: Rejected due to make 'mercedes-benz' containing 'mercedes' and model 'citan' containing 'citan'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:21:17Z',
 'fuel_type': 'diesel',
 'id': '6bb40336-50d0-54d4-b60b-ad3ddef7d6aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL64379',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 141643,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL64379%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [auto1.es] INFO: Saving data for HL64379: {'auction_closing_time': 1769703677.0, 'created_time': 1768401986.30958, 'last_price_update_time': 1769619938.256272}
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL64379') HTTP/1.1" 204 0
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_fef670c2474d4fc0389213ef3d707ab0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fef670c2474d4fc0389213ef3d707ab0.jpg not downloaded yet
2026-01-28 17:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-01-28 17:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 2
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53eb734-9f85-5b69-9861-5858f18c7942 with scrape type 2
2026-01-28 17:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e53eb734-9f85-5b69-9861-5858f18c7942, identifier: FV98550
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg not downloaded yet
2026-01-28 17:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-01-28 17:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550
2026-01-28 17:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e53eb734-9f85-5b69-9861-5858f18c7942 with identifier: FV98550 to the API
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FV98550>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:25:19Z',
 'fuel_type': 'diesel',
 'id': 'e53eb734-9f85-5b69-9861-5858f18c7942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV98550',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 80603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV98550%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [auto1.es] INFO: Saving data for FV98550: {'auction_closing_time': 1769703919.0, 'created_time': 1768237395.510276, 'last_price_update_time': 1769619938.729333}
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV98550') HTTP/1.1" 204 0
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg not downloaded yet
2026-01-28 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN21333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE67955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ62505> (referer: https://www.auto1.com/v1/car-details-view/XZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_415433cb90de9b2e6492127c8ead2856.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_415433cb90de9b2e6492127c8ead2856.jpg not downloaded yet
2026-01-28 17:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_32a8bc4573203f45fedc70357d815bd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_32a8bc4573203f45fedc70357d815bd1.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_e09b270794b22dc42d3f6d00c782e071.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e09b270794b22dc42d3f6d00c782e071.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_ae5b823a895fb6d4d051939146ed395a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_ae5b823a895fb6d4d051939146ed395a.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_69b1328a08bdc929d664292e52d39492.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_69b1328a08bdc929d664292e52d39492.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg not downloaded yet
2026-01-28 17:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_24010e98adf24504eec9d3fe8a63c92b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_24010e98adf24504eec9d3fe8a63c92b.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_e6c5e96e2336c18572821146af58a002.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e6c5e96e2336c18572821146af58a002.jpg not downloaded yet
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg not downloaded yet
2026-01-28 17:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2026-01-28 17:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6318819-4e1b-5e2c-8810-ce170762400c with scrape type 2
2026-01-28 17:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6318819-4e1b-5e2c-8810-ce170762400c with scrape type 2
2026-01-28 17:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a6318819-4e1b-5e2c-8810-ce170762400c, identifier: XZ62505
2026-01-28 17:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2026-01-28 17:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505
2026-01-28 17:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a6318819-4e1b-5e2c-8810-ce170762400c with identifier: XZ62505 to the API
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ62505>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:54:07Z',
 'fuel_type': 'diesel',
 'id': 'a6318819-4e1b-5e2c-8810-ce170762400c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ62505',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 32878,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ62505%27 HTTP/1.1" 200 None
2026-01-28 17:05:39 [auto1.es] INFO: Saving data for XZ62505: {'auction_closing_time': 1769705647.0, 'created_time': 1768237401.134741, 'last_price_update_time': 1769619939.336238}
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ62505') HTTP/1.1" 204 0
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg not downloaded yet
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA12366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_fa3231148edc6de5100390c38c87dbe2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fa3231148edc6de5100390c38c87dbe2.jpg not downloaded yet
2026-01-28 17:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ13616> (referer: https://www.auto1.com/v1/car-details-view/WJ13616/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6347aa50>
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg saved to cache
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU52604> (referer: https://www.auto1.com/v1/car-details-view/WU52604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL43713> (referer: https://www.auto1.com/v1/car-details-view/GL43713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE51179> (referer: https://www.auto1.com/v1/car-details-view/DE51179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627ebf10>
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg saved to cache
2026-01-28 17:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63361b90>
2026-01-28 17:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg saved to cache
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be09a07-fd54-5da7-acb7-eb455affa371 with identifier: WJ13616
2026-01-28 17:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be09a07-fd54-5da7-acb7-eb455affa371 with scrape type 2
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5be09a07-fd54-5da7-acb7-eb455affa371 with scrape type 2
2026-01-28 17:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5be09a07-fd54-5da7-acb7-eb455affa371, identifier: WJ13616
2026-01-28 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5be09a07-fd54-5da7-acb7-eb455affa371 with identifier: WJ13616
2026-01-28 17:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5be09a07-fd54-5da7-acb7-eb455affa371 with identifier: WJ13616
2026-01-28 17:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-28 17:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5be09a07-fd54-5da7-acb7-eb455affa371 spider: auto1.es
2026-01-28 17:05:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5be09a07-fd54-5da7-acb7-eb455affa371 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:23:35Z',
 'fuel_type': 'diesel',
 'id': '5be09a07-fd54-5da7-acb7-eb455affa371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ13616',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 56000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Basis L1',
 'transmission': 'manual',
 'trim': 'Basis L1',
 'year': 2023}
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WJ13616%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [auto1.es] INFO: Saving data for WJ13616: {'auction_closing_time': 1769703815.0, 'created_time': 1768323755.326478, 'last_price_update_time': 1769619940.479017}
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ13616') HTTP/1.1" 204 0
2026-01-28 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH75586/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK40804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a51133-af45-58c6-bea9-cb134b3abf11 with identifier: WU52604
2026-01-28 17:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a51133-af45-58c6-bea9-cb134b3abf11 with scrape type 2
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a51133-af45-58c6-bea9-cb134b3abf11 with scrape type 2
2026-01-28 17:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13a51133-af45-58c6-bea9-cb134b3abf11, identifier: WU52604
2026-01-28 17:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75421c55-3b7a-5270-89c8-70a64248a8b4 with identifier: GL43713
2026-01-28 17:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75421c55-3b7a-5270-89c8-70a64248a8b4 with scrape type 1
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 75421c55-3b7a-5270-89c8-70a64248a8b4
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_d529d894aa480ea87b4b435f9b3ed213.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d529d894aa480ea87b4b435f9b3ed213.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_2f75d339ff437029baebf0b4120ef96c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_2f75d339ff437029baebf0b4120ef96c.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_7d3cf4a576cec01682f5f5bbb2772a77.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_7d3cf4a576cec01682f5f5bbb2772a77.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_ec7a5162cfb5e74ede0bfcbedf5dcf15.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_ec7a5162cfb5e74ede0bfcbedf5dcf15.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_6bcab11a8d56856566208e8d6c95447f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_6bcab11a8d56856566208e8d6c95447f.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_4d0f7e62e7fb6ed387c3838b36daaee5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_4d0f7e62e7fb6ed387c3838b36daaee5.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_8f511b7f71c825126c890ee8e766a01e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_8f511b7f71c825126c890ee8e766a01e.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_b9135b7335a6f10fffb8a454dcec2e9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_b9135b7335a6f10fffb8a454dcec2e9e.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_5a5749a2c156cc841bcd25bbfd62cc7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_5a5749a2c156cc841bcd25bbfd62cc7b.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_d1ed2d9e8113fb6e5eb6ada77a277017.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d1ed2d9e8113fb6e5eb6ada77a277017.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_76531d2b3248dc218c76fbc02fc8f396.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_76531d2b3248dc218c76fbc02fc8f396.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_3ec04700d0e61af6810d009c57a3cc94.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_3ec04700d0e61af6810d009c57a3cc94.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_54e223e6612485401151da8eaa9a7657.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_54e223e6612485401151da8eaa9a7657.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_83c3334d0af659d52e940be120756303.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_83c3334d0af659d52e940be120756303.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_924ff5ad3da81bf1e78680ae4da04161.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_924ff5ad3da81bf1e78680ae4da04161.jpg already downloaded
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F98%252F4b9874cb278e2cd5c648ad8fe3b9bc09%252Fpa%252FGL43713_bd65c4db3733ede553661d020f6f7060.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_bd65c4db3733ede553661d020f6f7060.jpg already downloaded
2026-01-28 17:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 75421c55-3b7a-5270-89c8-70a64248a8b4, identifier: GL43713
2026-01-28 17:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2026-01-28 17:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45624cdd-c209-5b62-82e2-d303a80525c2 with scrape type 2
2026-01-28 17:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45624cdd-c209-5b62-82e2-d303a80525c2 with scrape type 2
2026-01-28 17:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 45624cdd-c209-5b62-82e2-d303a80525c2, identifier: DE51179
2026-01-28 17:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13a51133-af45-58c6-bea9-cb134b3abf11 with identifier: WU52604
2026-01-28 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13a51133-af45-58c6-bea9-cb134b3abf11 with identifier: WU52604
2026-01-28 17:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13a51133-af45-58c6-bea9-cb134b3abf11 with identifier: WU52604 to the API
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WU52604>
{'auction_title': '',
 'c_o_2_emission_value': 244,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 390,
 'expiration_date': '2026-01-29T16:34:26Z',
 'fuel_type': 'petrol',
 'id': '13a51133-af45-58c6-bea9-cb134b3abf11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU52604',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 72634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU52604%27 HTTP/1.1" 200 None
2026-01-28 17:05:41 [auto1.es] INFO: Saving data for WU52604: {'auction_closing_time': 1769704466.0, 'created_time': 1764064950.774314, 'last_price_update_time': 1769619941.451932}
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU52604') HTTP/1.1" 204 0
2026-01-28 17:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 75421c55-3b7a-5270-89c8-70a64248a8b4 with identifier: GL43713
2026-01-28 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 75421c55-3b7a-5270-89c8-70a64248a8b4 with identifier: GL43713
2026-01-28 17:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 75421c55-3b7a-5270-89c8-70a64248a8b4 with identifier: GL43713 to the API
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL43713>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:06:14Z',
 'fuel_type': 'diesel',
 'id': '75421c55-3b7a-5270-89c8-70a64248a8b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL43713',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 55779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d529d894aa480ea87b4b435f9b3ed213.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_2f75d339ff437029baebf0b4120ef96c.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_7d3cf4a576cec01682f5f5bbb2772a77.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_ec7a5162cfb5e74ede0bfcbedf5dcf15.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_6bcab11a8d56856566208e8d6c95447f.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_4d0f7e62e7fb6ed387c3838b36daaee5.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_8f511b7f71c825126c890ee8e766a01e.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_b9135b7335a6f10fffb8a454dcec2e9e.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_5a5749a2c156cc841bcd25bbfd62cc7b.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d1ed2d9e8113fb6e5eb6ada77a277017.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_76531d2b3248dc218c76fbc02fc8f396.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_3ec04700d0e61af6810d009c57a3cc94.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_54e223e6612485401151da8eaa9a7657.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_83c3334d0af659d52e940be120756303.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_924ff5ad3da81bf1e78680ae4da04161.jpg',
                'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_bd65c4db3733ede553661d020f6f7060.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d529d894aa480ea87b4b435f9b3ed213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_2f75d339ff437029baebf0b4120ef96c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_7d3cf4a576cec01682f5f5bbb2772a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_ec7a5162cfb5e74ede0bfcbedf5dcf15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_6bcab11a8d56856566208e8d6c95447f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_4d0f7e62e7fb6ed387c3838b36daaee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_8f511b7f71c825126c890ee8e766a01e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_b9135b7335a6f10fffb8a454dcec2e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_5a5749a2c156cc841bcd25bbfd62cc7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_d1ed2d9e8113fb6e5eb6ada77a277017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_76531d2b3248dc218c76fbc02fc8f396.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_3ec04700d0e61af6810d009c57a3cc94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_54e223e6612485401151da8eaa9a7657.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_83c3334d0af659d52e940be120756303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_924ff5ad3da81bf1e78680ae4da04161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75421c55-3b7a-5270-89c8-70a64248a8b4/75421c55-3b7a-5270-89c8-70a64248a8b4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/98/4b9874cb278e2cd5c648ad8fe3b9bc09/pa/GL43713_bd65c4db3733ede553661d020f6f7060.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.5 Blue-HDi Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2021}
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL43713%27 HTTP/1.1" 200 None
2026-01-28 17:05:41 [auto1.es] INFO: Saving data for GL43713: {'created_time': 1769619941.755259, 'last_price_update_time': 1769619941.75527, 'auction_closing_time': 1769702774.0}
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GL43713') HTTP/1.1" 204 0
2026-01-28 17:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2026-01-28 17:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179
2026-01-28 17:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 45624cdd-c209-5b62-82e2-d303a80525c2 with identifier: DE51179 to the API
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DE51179>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:55:50Z',
 'fuel_type': 'diesel',
 'id': '45624cdd-c209-5b62-82e2-d303a80525c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE51179',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 73865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE51179%27 HTTP/1.1" 200 None
2026-01-28 17:05:42 [auto1.es] INFO: Saving data for DE51179: {'auction_closing_time': 1769705750.0, 'created_time': 1768237425.312181, 'last_price_update_time': 1769619942.085793}
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE51179') HTTP/1.1" 204 0
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e6c5e96e2336c18572821146af58a002.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_24010e98adf24504eec9d3fe8a63c92b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fa3231148edc6de5100390c38c87dbe2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR29663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH09683/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62656810>
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg saved to cache
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_69b1328a08bdc929d664292e52d39492.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_ae5b823a895fb6d4d051939146ed395a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63584d90>
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_e6c5e96e2336c18572821146af58a002.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e6c5e96e2336c18572821146af58a002.jpg saved to cache
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6265da50>
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_24010e98adf24504eec9d3fe8a63c92b.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_24010e98adf24504eec9d3fe8a63c92b.jpg saved to cache
2026-01-28 17:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272cc90>
2026-01-28 17:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_fa3231148edc6de5100390c38c87dbe2.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fa3231148edc6de5100390c38c87dbe2.jpg saved to cache
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fef670c2474d4fc0389213ef3d707ab0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_415433cb90de9b2e6492127c8ead2856.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_32a8bc4573203f45fedc70357d815bd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e09b270794b22dc42d3f6d00c782e071.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JS12775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL66234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW49246/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX60212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62809910>
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_69b1328a08bdc929d664292e52d39492.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_69b1328a08bdc929d664292e52d39492.jpg saved to cache
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6348a990>
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_ae5b823a895fb6d4d051939146ed395a.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_ae5b823a895fb6d4d051939146ed395a.jpg saved to cache
2026-01-28 17:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE67955> (referer: https://www.auto1.com/v1/car-details-view/BE67955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63467510>
2026-01-28 17:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_fef670c2474d4fc0389213ef3d707ab0.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fef670c2474d4fc0389213ef3d707ab0.jpg saved to cache
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b4990>
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_415433cb90de9b2e6492127c8ead2856.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_415433cb90de9b2e6492127c8ead2856.jpg saved to cache
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290ed10>
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg saved to cache
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6273d5d0>
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_32a8bc4573203f45fedc70357d815bd1.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_32a8bc4573203f45fedc70357d815bd1.jpg saved to cache
2026-01-28 17:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62702890>
2026-01-28 17:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_e09b270794b22dc42d3f6d00c782e071.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e09b270794b22dc42d3f6d00c782e071.jpg saved to cache
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7e7273542b481e04c966d41ec177bfb4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ79125> (referer: https://www.auto1.com/v1/car-details-view/BJ79125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN21333> (referer: https://www.auto1.com/v1/car-details-view/YN21333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA12366> (referer: https://www.auto1.com/v1/car-details-view/EA12366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with identifier: BE67955
2026-01-28 17:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with scrape type 2
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with scrape type 2
2026-01-28 17:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49bdcfdc-35dd-53e4-be72-e37e8ac11617, identifier: BE67955
2026-01-28 17:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with identifier: BE67955
2026-01-28 17:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with identifier: BE67955
2026-01-28 17:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49bdcfdc-35dd-53e4-be72-e37e8ac11617 with identifier: BE67955 to the API
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE67955>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:58:15Z',
 'fuel_type': 'diesel',
 'id': '49bdcfdc-35dd-53e4-be72-e37e8ac11617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE67955',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 90729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE67955%27 HTTP/1.1" 200 None
2026-01-28 17:05:45 [auto1.es] INFO: Saving data for BE67955: {'auction_closing_time': 1769705895.0, 'created_time': 1768237421.392557, 'last_price_update_time': 1769619945.496415}
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE67955') HTTP/1.1" 204 0
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260bc90>
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_7e7273542b481e04c966d41ec177bfb4.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7e7273542b481e04c966d41ec177bfb4.jpg saved to cache
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3687d928-5c5f-586e-a30a-de42ff523f9d with identifier: BJ79125
2026-01-28 17:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3687d928-5c5f-586e-a30a-de42ff523f9d with scrape type 2
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3687d928-5c5f-586e-a30a-de42ff523f9d with scrape type 2
2026-01-28 17:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3687d928-5c5f-586e-a30a-de42ff523f9d, identifier: BJ79125
2026-01-28 17:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 265370fb-553a-5d43-93d3-55e15e6d09ee with identifier: YN21333
2026-01-28 17:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 265370fb-553a-5d43-93d3-55e15e6d09ee with scrape type 2
2026-01-28 17:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 265370fb-553a-5d43-93d3-55e15e6d09ee with scrape type 2
2026-01-28 17:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 265370fb-553a-5d43-93d3-55e15e6d09ee, identifier: YN21333
2026-01-28 17:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c545bb21-f421-5377-a14a-66fbca2f8ece with identifier: EA12366
2026-01-28 17:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c545bb21-f421-5377-a14a-66fbca2f8ece with scrape type 2
2026-01-28 17:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c545bb21-f421-5377-a14a-66fbca2f8ece with scrape type 2
2026-01-28 17:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c545bb21-f421-5377-a14a-66fbca2f8ece, identifier: EA12366
2026-01-28 17:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3687d928-5c5f-586e-a30a-de42ff523f9d with identifier: BJ79125
2026-01-28 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3687d928-5c5f-586e-a30a-de42ff523f9d with identifier: BJ79125
2026-01-28 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 138509 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    138509
2026-01-28 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 3687d928-5c5f-586e-a30a-de42ff523f9d spider: auto1.es
2026-01-28 17:05:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3687d928-5c5f-586e-a30a-de42ff523f9d due to rule: high_mileage_for_make.json, error: 138509 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    138509
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:47:30Z',
 'fuel_type': 'diesel',
 'id': '3687d928-5c5f-586e-a30a-de42ff523f9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ79125',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 138509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ79125%27 HTTP/1.1" 200 None
2026-01-28 17:05:46 [auto1.es] INFO: Saving data for BJ79125: {'auction_closing_time': 1769705250.0, 'created_time': 1769148111.558434, 'last_price_update_time': 1769619946.315876}
2026-01-28 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ79125') HTTP/1.1" 204 0
2026-01-28 17:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 265370fb-553a-5d43-93d3-55e15e6d09ee with identifier: YN21333
2026-01-28 17:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 265370fb-553a-5d43-93d3-55e15e6d09ee with identifier: YN21333
2026-01-28 17:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 265370fb-553a-5d43-93d3-55e15e6d09ee with identifier: YN21333 to the API
2026-01-28 17:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YN21333>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:46:58Z',
 'fuel_type': 'diesel',
 'id': '265370fb-553a-5d43-93d3-55e15e6d09ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN21333',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 86817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN21333%27 HTTP/1.1" 200 None
2026-01-28 17:05:47 [auto1.es] INFO: Saving data for YN21333: {'auction_closing_time': 1769705218.0, 'created_time': 1768410365.495177, 'last_price_update_time': 1769619947.511986}
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YN21333') HTTP/1.1" 204 0
2026-01-28 17:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c545bb21-f421-5377-a14a-66fbca2f8ece with identifier: EA12366
2026-01-28 17:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c545bb21-f421-5377-a14a-66fbca2f8ece with identifier: EA12366
2026-01-28 17:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c545bb21-f421-5377-a14a-66fbca2f8ece with identifier: EA12366 to the API
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EA12366>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:47:03Z',
 'fuel_type': 'diesel',
 'id': 'c545bb21-f421-5377-a14a-66fbca2f8ece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA12366',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '3er',
 'odometer': 117279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EA12366%27 HTTP/1.1" 200 None
2026-01-28 17:05:47 [auto1.es] INFO: Saving data for EA12366: {'auction_closing_time': 1769705223.0, 'created_time': 1768410373.780339, 'last_price_update_time': 1769619947.809973}
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EA12366') HTTP/1.1" 204 0
2026-01-28 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH09683> (referer: https://www.auto1.com/v1/car-details-view/DH09683/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK40804> (referer: https://www.auto1.com/v1/car-details-view/TK40804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH75586> (referer: https://www.auto1.com/v1/car-details-view/DH75586/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR29663> (referer: https://www.auto1.com/v1/car-details-view/XR29663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 973e58d8-a3fb-5316-baa9-82bbdeadca82 with identifier: DH09683
2026-01-28 17:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 973e58d8-a3fb-5316-baa9-82bbdeadca82 with scrape type 2
2026-01-28 17:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 973e58d8-a3fb-5316-baa9-82bbdeadca82 with scrape type 2
2026-01-28 17:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 973e58d8-a3fb-5316-baa9-82bbdeadca82, identifier: DH09683
2026-01-28 17:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42970aad-b47b-5bc6-901b-7363c8993e87 with identifier: TK40804
2026-01-28 17:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42970aad-b47b-5bc6-901b-7363c8993e87 with scrape type 1
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 42970aad-b47b-5bc6-901b-7363c8993e87
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_df60834f04a1a763b5cb42cbdcfcd19a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_df60834f04a1a763b5cb42cbdcfcd19a.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_aab013b2fcd7a2ceb6b77cbc6b72f5a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_aab013b2fcd7a2ceb6b77cbc6b72f5a3.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_8f31aced4583f913e44b5a14fd0a1d15.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8f31aced4583f913e44b5a14fd0a1d15.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_e0bb303eb340c29461243f2ef6eda85f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e0bb303eb340c29461243f2ef6eda85f.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_e58adbb49bfa822894aedc886548627b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e58adbb49bfa822894aedc886548627b.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_75e2ac4afcd27e81db6de08767fb6eb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_75e2ac4afcd27e81db6de08767fb6eb9.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_117f37a10669448d796db3c5e385c4af.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_117f37a10669448d796db3c5e385c4af.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_03fe6b59a1f6615db7e97a31e06bd6b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_03fe6b59a1f6615db7e97a31e06bd6b7.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_b5c23a1300a87eedc15775ef0b5a2583.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_b5c23a1300a87eedc15775ef0b5a2583.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_66af5cd60d0e487926d8244ffedf9f3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_66af5cd60d0e487926d8244ffedf9f3b.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_4849deee782185fe44dc5b86bee22fbd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_4849deee782185fe44dc5b86bee22fbd.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_7363acc016022f8562ab71eb80d7ddc9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_7363acc016022f8562ab71eb80d7ddc9.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_8e9dc6b63bf739ecf1c13d86cd281c0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8e9dc6b63bf739ecf1c13d86cd281c0d.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_61ec5ca64004e1423a68c6bccf7bdf6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_61ec5ca64004e1423a68c6bccf7bdf6a.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F9b%252Fec9bbf9d1262aab3952d1f3c53a54fbf%252Fpa%252FTK40804_57fc148735de86d295d39f081c484df0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_57fc148735de86d295d39f081c484df0.jpg already downloaded
2026-01-28 17:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 42970aad-b47b-5bc6-901b-7363c8993e87, identifier: TK40804
2026-01-28 17:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with identifier: DH75586
2026-01-28 17:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with scrape type 2
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with scrape type 2
2026-01-28 17:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f89f40bf-7e9e-5838-b6bc-5dbbc6a68255, identifier: DH75586
2026-01-28 17:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd3dff56-758e-536f-b396-63ac9bf9f37d with identifier: XR29663
2026-01-28 17:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd3dff56-758e-536f-b396-63ac9bf9f37d with scrape type 1
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item dd3dff56-758e-536f-b396-63ac9bf9f37d
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_fc062e446d8f0dc0b3f08548aa1423f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_fc062e446d8f0dc0b3f08548aa1423f8.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_4d276acf64fe039a70d97771646bf873.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_4d276acf64fe039a70d97771646bf873.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_755325216fecd13b61269e2ed9a3a40f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_755325216fecd13b61269e2ed9a3a40f.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_b6e09244ee2e054c1078561a63ba5889.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b6e09244ee2e054c1078561a63ba5889.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_7f8b5240768b4ddab03eef911250253a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_7f8b5240768b4ddab03eef911250253a.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_b9ac6bd6dffe391e0cf9153890e6aa1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b9ac6bd6dffe391e0cf9153890e6aa1d.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_9b01d589603769b283572dac65f74987.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9b01d589603769b283572dac65f74987.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_800c95c93073603a9589f9bd91f8f157.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_800c95c93073603a9589f9bd91f8f157.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_af5cb836228c68dc557e9fe74c9bfecc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_af5cb836228c68dc557e9fe74c9bfecc.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_daf1b7bcf191e40175a3ae0933551dd8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_daf1b7bcf191e40175a3ae0933551dd8.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_2b0a8d2247e644e1762220bc698376e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2b0a8d2247e644e1762220bc698376e2.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_a62aa9ed31998199625d18e1761f5e79.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_a62aa9ed31998199625d18e1761f5e79.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_b2ffcd235457c75f2e58eb0772c8132d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b2ffcd235457c75f2e58eb0772c8132d.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_9cd98ead3bedf217d5d4a2b87c562091.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9cd98ead3bedf217d5d4a2b87c562091.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_619a840f8c3bc1eac278e91b22217955.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_619a840f8c3bc1eac278e91b22217955.jpg already downloaded
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fa7%252F11a7e30d0645eaaafa00dc2b0a81fd48%252Fpa%252FXR29663_2048e2e20d20ac6c00e19f3902f9fada.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2048e2e20d20ac6c00e19f3902f9fada.jpg already downloaded
2026-01-28 17:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd3dff56-758e-536f-b396-63ac9bf9f37d, identifier: XR29663
2026-01-28 17:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 973e58d8-a3fb-5316-baa9-82bbdeadca82 with identifier: DH09683
2026-01-28 17:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 973e58d8-a3fb-5316-baa9-82bbdeadca82 with identifier: DH09683
2026-01-28 17:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 973e58d8-a3fb-5316-baa9-82bbdeadca82 with identifier: DH09683 to the API
2026-01-28 17:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DH09683>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:31:29Z',
 'fuel_type': 'petrol',
 'id': '973e58d8-a3fb-5316-baa9-82bbdeadca82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH09683',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 141868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2017}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH09683%27 HTTP/1.1" 200 None
2026-01-28 17:05:49 [auto1.es] INFO: Saving data for DH09683: {'auction_closing_time': 1769704289.0, 'created_time': 1768457186.712606, 'last_price_update_time': 1769619949.29038}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH09683') HTTP/1.1" 204 0
2026-01-28 17:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 42970aad-b47b-5bc6-901b-7363c8993e87 with identifier: TK40804
2026-01-28 17:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 42970aad-b47b-5bc6-901b-7363c8993e87 with identifier: TK40804
2026-01-28 17:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 42970aad-b47b-5bc6-901b-7363c8993e87 with identifier: TK40804 to the API
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK40804>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:37:21Z',
 'fuel_type': 'diesel',
 'id': '42970aad-b47b-5bc6-901b-7363c8993e87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK40804',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 77480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_df60834f04a1a763b5cb42cbdcfcd19a.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_aab013b2fcd7a2ceb6b77cbc6b72f5a3.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8f31aced4583f913e44b5a14fd0a1d15.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e0bb303eb340c29461243f2ef6eda85f.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e58adbb49bfa822894aedc886548627b.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_75e2ac4afcd27e81db6de08767fb6eb9.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_117f37a10669448d796db3c5e385c4af.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_03fe6b59a1f6615db7e97a31e06bd6b7.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_b5c23a1300a87eedc15775ef0b5a2583.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_66af5cd60d0e487926d8244ffedf9f3b.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_4849deee782185fe44dc5b86bee22fbd.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_7363acc016022f8562ab71eb80d7ddc9.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8e9dc6b63bf739ecf1c13d86cd281c0d.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_61ec5ca64004e1423a68c6bccf7bdf6a.jpg',
                'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_57fc148735de86d295d39f081c484df0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_df60834f04a1a763b5cb42cbdcfcd19a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_aab013b2fcd7a2ceb6b77cbc6b72f5a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8f31aced4583f913e44b5a14fd0a1d15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e0bb303eb340c29461243f2ef6eda85f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_e58adbb49bfa822894aedc886548627b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_75e2ac4afcd27e81db6de08767fb6eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_117f37a10669448d796db3c5e385c4af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_03fe6b59a1f6615db7e97a31e06bd6b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_b5c23a1300a87eedc15775ef0b5a2583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_66af5cd60d0e487926d8244ffedf9f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_4849deee782185fe44dc5b86bee22fbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_7363acc016022f8562ab71eb80d7ddc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_8e9dc6b63bf739ecf1c13d86cd281c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_61ec5ca64004e1423a68c6bccf7bdf6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42970aad-b47b-5bc6-901b-7363c8993e87/42970aad-b47b-5bc6-901b-7363c8993e87_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/9b/ec9bbf9d1262aab3952d1f3c53a54fbf/pa/TK40804_57fc148735de86d295d39f081c484df0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.5 Blue-HDi Feel Pack',
 'transmission': 'manual',
 'trim': 'Feel Pack',
 'year': 2022}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TK40804%27 HTTP/1.1" 200 None
2026-01-28 17:05:49 [auto1.es] INFO: Saving data for TK40804: {'created_time': 1769619949.611471, 'last_price_update_time': 1769619949.611481, 'auction_closing_time': 1769704641.0}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TK40804') HTTP/1.1" 204 0
2026-01-28 17:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with identifier: DH75586
2026-01-28 17:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with identifier: DH75586
2026-01-28 17:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f89f40bf-7e9e-5838-b6bc-5dbbc6a68255 with identifier: DH75586 to the API
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DH75586>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:29:59Z',
 'fuel_type': 'diesel',
 'id': 'f89f40bf-7e9e-5838-b6bc-5dbbc6a68255',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH75586',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 39100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2024}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH75586%27 HTTP/1.1" 200 None
2026-01-28 17:05:49 [auto1.es] INFO: Saving data for DH75586: {'auction_closing_time': 1769704199.0, 'created_time': 1768410353.644757, 'last_price_update_time': 1769619949.946319}
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH75586') HTTP/1.1" 204 0
2026-01-28 17:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd3dff56-758e-536f-b396-63ac9bf9f37d with identifier: XR29663
2026-01-28 17:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd3dff56-758e-536f-b396-63ac9bf9f37d with identifier: XR29663
2026-01-28 17:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dd3dff56-758e-536f-b396-63ac9bf9f37d with identifier: XR29663 to the API
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR29663>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:01:24Z',
 'fuel_type': 'petrol',
 'id': 'dd3dff56-758e-536f-b396-63ac9bf9f37d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR29663',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 26357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_fc062e446d8f0dc0b3f08548aa1423f8.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_4d276acf64fe039a70d97771646bf873.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_755325216fecd13b61269e2ed9a3a40f.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b6e09244ee2e054c1078561a63ba5889.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_7f8b5240768b4ddab03eef911250253a.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b9ac6bd6dffe391e0cf9153890e6aa1d.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9b01d589603769b283572dac65f74987.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_800c95c93073603a9589f9bd91f8f157.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_af5cb836228c68dc557e9fe74c9bfecc.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_daf1b7bcf191e40175a3ae0933551dd8.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2b0a8d2247e644e1762220bc698376e2.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_a62aa9ed31998199625d18e1761f5e79.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b2ffcd235457c75f2e58eb0772c8132d.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9cd98ead3bedf217d5d4a2b87c562091.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_619a840f8c3bc1eac278e91b22217955.jpg',
                'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2048e2e20d20ac6c00e19f3902f9fada.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_fc062e446d8f0dc0b3f08548aa1423f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_4d276acf64fe039a70d97771646bf873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_755325216fecd13b61269e2ed9a3a40f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b6e09244ee2e054c1078561a63ba5889.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_7f8b5240768b4ddab03eef911250253a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b9ac6bd6dffe391e0cf9153890e6aa1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9b01d589603769b283572dac65f74987.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_800c95c93073603a9589f9bd91f8f157.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_af5cb836228c68dc557e9fe74c9bfecc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_daf1b7bcf191e40175a3ae0933551dd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2b0a8d2247e644e1762220bc698376e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_a62aa9ed31998199625d18e1761f5e79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_b2ffcd235457c75f2e58eb0772c8132d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_9cd98ead3bedf217d5d4a2b87c562091.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_619a840f8c3bc1eac278e91b22217955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd3dff56-758e-536f-b396-63ac9bf9f37d/dd3dff56-758e-536f-b396-63ac9bf9f37d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76580,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/a7/11a7e30d0645eaaafa00dc2b0a81fd48/pa/XR29663_2048e2e20d20ac6c00e19f3902f9fada.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI Style XM',
 'transmission': 'manual',
 'trim': 'Style XM',
 'year': 2023}
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR29663%27 HTTP/1.1" 200 None
2026-01-28 17:05:50 [auto1.es] INFO: Saving data for XR29663: {'created_time': 1769619950.274366, 'last_price_update_time': 1769619950.274382, 'auction_closing_time': 1769702484.0}
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR29663') HTTP/1.1" 204 0
2026-01-28 17:05:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63320110>
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0b%252F6b0b879b45c8cb1c78d9425f03de12be%252Fpa%252FFU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg saved to cache
2026-01-28 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30
2026-01-28 17:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c1ec88c-4196-5a8f-a986-f33a1257ae30, skipping ID generation
2026-01-28 17:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30 with scrape type 1
2026-01-28 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9c1ec88c-4196-5a8f-a986-f33a1257ae30 from tracking dictionaries
2026-01-28 17:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c1ec88c-4196-5a8f-a986-f33a1257ae30 sending to next pipeline
2026-01-28 17:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9c1ec88c-4196-5a8f-a986-f33a1257ae30, identifier: FU11431
2026-01-28 17:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9c1ec88c-4196-5a8f-a986-f33a1257ae30 with identifier: FU11431
2026-01-28 17:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9c1ec88c-4196-5a8f-a986-f33a1257ae30 with identifier: FU11431
2026-01-28 17:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182155 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182155
2026-01-28 17:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9c1ec88c-4196-5a8f-a986-f33a1257ae30 spider: auto1.es
2026-01-28 17:05:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9c1ec88c-4196-5a8f-a986-f33a1257ae30 due to rule: high_mileage_for_country.json, error: 182155 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182155
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:20:03Z',
 'fuel_type': 'diesel',
 'id': '9c1ec88c-4196-5a8f-a986-f33a1257ae30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU11431',
 'listing': 'auction',
 'location': 'ES, La Pobla de Valbona',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 182155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7e7273542b481e04c966d41ec177bfb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_7cdf094767d0af5a2d8803c64d6364e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fef670c2474d4fc0389213ef3d707ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_33663f770e8d3f55e6c7f3ca1d18dfca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_aa7bb6d18c8092a80c0dc04ffa825b24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_415433cb90de9b2e6492127c8ead2856.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_32a8bc4573203f45fedc70357d815bd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e09b270794b22dc42d3f6d00c782e071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_ae5b823a895fb6d4d051939146ed395a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_69b1328a08bdc929d664292e52d39492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_0614ab15ee64dd1ee42f640e159e0bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_24010e98adf24504eec9d3fe8a63c92b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_e6c5e96e2336c18572821146af58a002.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2172028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_c3d85b355b98a1d43fa2fb1fadd0e061.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_dc5f01876b75976ad60a2c4d47fb5255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c1ec88c-4196-5a8f-a986-f33a1257ae30/9c1ec88c-4196-5a8f-a986-f33a1257ae30_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0b/6b0b879b45c8cb1c78d9425f03de12be/pa/FU11431_fa3231148edc6de5100390c38c87dbe2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU11431%27 HTTP/1.1" 200 None
2026-01-28 17:05:50 [auto1.es] INFO: Saving data for FU11431: {'created_time': 1769619950.936606, 'last_price_update_time': 1769619950.93662, 'auction_closing_time': 1769703603.0}
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FU11431') HTTP/1.1" 204 0
2026-01-28 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL07637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB59452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD74245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RK21190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KF67108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX51290> (referer: https://www.auto1.com/v1/car-details-view/CX51290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8099d2-8656-5744-998a-08374a174ee8 with identifier: CX51290
2026-01-28 17:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8099d2-8656-5744-998a-08374a174ee8 with scrape type 2
2026-01-28 17:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f8099d2-8656-5744-998a-08374a174ee8 with scrape type 2
2026-01-28 17:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f8099d2-8656-5744-998a-08374a174ee8, identifier: CX51290
2026-01-28 17:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f8099d2-8656-5744-998a-08374a174ee8 with identifier: CX51290
2026-01-28 17:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f8099d2-8656-5744-998a-08374a174ee8 with identifier: CX51290
2026-01-28 17:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f8099d2-8656-5744-998a-08374a174ee8 with identifier: CX51290 to the API
2026-01-28 17:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX51290>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:28:24Z',
 'fuel_type': 'diesel',
 'id': '7f8099d2-8656-5744-998a-08374a174ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX51290',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 48398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CX51290%27 HTTP/1.1" 200 None
2026-01-28 17:05:52 [auto1.es] INFO: Saving data for CX51290: {'auction_closing_time': 1769704104.0, 'created_time': 1768237418.975649, 'last_price_update_time': 1769619952.693498}
2026-01-28 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CX51290') HTTP/1.1" 204 0
2026-01-28 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE01267> (referer: https://www.auto1.com/v1/car-details-view/WE01267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX60212> (referer: https://www.auto1.com/v1/car-details-view/VX60212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW49246> (referer: https://www.auto1.com/v1/car-details-view/LW49246/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL66234> (referer: https://www.auto1.com/v1/car-details-view/DL66234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8776d346-c7d1-5f32-b3c1-98596148016c with identifier: WE01267
2026-01-28 17:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8776d346-c7d1-5f32-b3c1-98596148016c with scrape type 2
2026-01-28 17:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8776d346-c7d1-5f32-b3c1-98596148016c with scrape type 2
2026-01-28 17:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8776d346-c7d1-5f32-b3c1-98596148016c, identifier: WE01267
2026-01-28 17:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8776d346-c7d1-5f32-b3c1-98596148016c with identifier: WE01267
2026-01-28 17:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8776d346-c7d1-5f32-b3c1-98596148016c with identifier: WE01267
2026-01-28 17:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159107 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159107
2026-01-28 17:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8776d346-c7d1-5f32-b3c1-98596148016c spider: auto1.es
2026-01-28 17:05:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8776d346-c7d1-5f32-b3c1-98596148016c due to rule: high_mileage_for_country.json, error: 159107 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159107
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:55:04Z',
 'fuel_type': 'diesel',
 'id': '8776d346-c7d1-5f32-b3c1-98596148016c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE01267',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 159107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WE01267%27 HTTP/1.1" 200 None
2026-01-28 17:05:53 [auto1.es] INFO: Saving data for WE01267: {'auction_closing_time': 1769705704.0, 'created_time': 1766586404.052226, 'last_price_update_time': 1769619953.122897}
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WE01267') HTTP/1.1" 204 0
2026-01-28 17:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG13675/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with identifier: VX60212
2026-01-28 17:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with scrape type 1
2026-01-28 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_c54d0173f2b2ce51944eb87261262d09.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c54d0173f2b2ce51944eb87261262d09.jpg not downloaded yet
2026-01-28 17:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2862cfa-4291-581b-ae46-34766c87b25c with identifier: LW49246
2026-01-28 17:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2862cfa-4291-581b-ae46-34766c87b25c with scrape type 2
2026-01-28 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2862cfa-4291-581b-ae46-34766c87b25c with scrape type 2
2026-01-28 17:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e2862cfa-4291-581b-ae46-34766c87b25c, identifier: LW49246
2026-01-28 17:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03b1b6f-17f0-54e3-b307-b81150abef71 with identifier: DL66234
2026-01-28 17:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03b1b6f-17f0-54e3-b307-b81150abef71 with scrape type 2
2026-01-28 17:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03b1b6f-17f0-54e3-b307-b81150abef71 with scrape type 2
2026-01-28 17:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b03b1b6f-17f0-54e3-b307-b81150abef71, identifier: DL66234
2026-01-28 17:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e2862cfa-4291-581b-ae46-34766c87b25c with identifier: LW49246
2026-01-28 17:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e2862cfa-4291-581b-ae46-34766c87b25c with identifier: LW49246
2026-01-28 17:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e2862cfa-4291-581b-ae46-34766c87b25c with identifier: LW49246 to the API
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LW49246>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:46:33Z',
 'fuel_type': 'diesel',
 'id': 'e2862cfa-4291-581b-ae46-34766c87b25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW49246',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 147791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LW49246%27 HTTP/1.1" 200 None
2026-01-28 17:05:53 [auto1.es] INFO: Saving data for LW49246: {'auction_closing_time': 1769705193.0, 'created_time': 1769148145.829673, 'last_price_update_time': 1769619953.683666}
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LW49246') HTTP/1.1" 204 0
2026-01-28 17:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b03b1b6f-17f0-54e3-b307-b81150abef71 with identifier: DL66234
2026-01-28 17:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b03b1b6f-17f0-54e3-b307-b81150abef71 with identifier: DL66234
2026-01-28 17:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b03b1b6f-17f0-54e3-b307-b81150abef71 with identifier: DL66234 to the API
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DL66234>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:47:08Z',
 'fuel_type': 'diesel',
 'id': 'b03b1b6f-17f0-54e3-b307-b81150abef71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL66234',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 27630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL66234%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [auto1.es] INFO: Saving data for DL66234: {'auction_closing_time': 1769705228.0, 'created_time': 1769148120.772339, 'last_price_update_time': 1769619954.011019}
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DL66234') HTTP/1.1" 204 0
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_354105b823aca7839049df9e07242bc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_354105b823aca7839049df9e07242bc3.jpg not downloaded yet
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH32569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK65705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_001960dc251550845b37526226603ab6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_001960dc251550845b37526226603ab6.jpg not downloaded yet
2026-01-28 17:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JS12775> (referer: https://www.auto1.com/v1/car-details-view/JS12775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_189e20aa82d811a59b76d35b9a83c328.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_189e20aa82d811a59b76d35b9a83c328.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_0e76861fb7457366546fc0a50215a23f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0e76861fb7457366546fc0a50215a23f.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg not downloaded yet
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_354105b823aca7839049df9e07242bc3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c54d0173f2b2ce51944eb87261262d09.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_96f42b61aa548ba150395f9b38b5659d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_96f42b61aa548ba150395f9b38b5659d.jpg not downloaded yet
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg not downloaded yet
2026-01-28 17:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 with identifier: JS12775
2026-01-28 17:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 with scrape type 2
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 with scrape type 2
2026-01-28 17:05:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7, identifier: JS12775
2026-01-28 17:05:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 with identifier: JS12775
2026-01-28 17:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 with identifier: JS12775
2026-01-28 17:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155371 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155371
2026-01-28 17:05:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 spider: auto1.es
2026-01-28 17:05:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e9824a2b-0fd7-5835-88ad-da0f3c74c1b7 due to rule: high_mileage_for_country.json, error: 155371 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155371
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:44:01Z',
 'fuel_type': 'diesel',
 'id': 'e9824a2b-0fd7-5835-88ad-da0f3c74c1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS12775',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 155371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS12775%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [auto1.es] INFO: Saving data for JS12775: {'auction_closing_time': 1769705041.0, 'created_time': 1769148132.574416, 'last_price_update_time': 1769619954.549847}
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JS12775') HTTP/1.1" 204 0
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_832dc518d81bac74dc5080c2c05035f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_832dc518d81bac74dc5080c2c05035f0.jpg not downloaded yet
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0e76861fb7457366546fc0a50215a23f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_35f39203ae9e23c008e6907418e6d7ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_35f39203ae9e23c008e6907418e6d7ac.jpg not downloaded yet
2026-01-28 17:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL71949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288c350>
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_354105b823aca7839049df9e07242bc3.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_354105b823aca7839049df9e07242bc3.jpg saved to cache
2026-01-28 17:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5ee50>
2026-01-28 17:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_c54d0173f2b2ce51944eb87261262d09.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c54d0173f2b2ce51944eb87261262d09.jpg saved to cache
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg not downloaded yet
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF74098/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV41584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT38971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY44668/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6275c810>
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_0e76861fb7457366546fc0a50215a23f.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0e76861fb7457366546fc0a50215a23f.jpg saved to cache
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62735b90>
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg saved to cache
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_353553205ccd3be47e3ac48c26dbfded.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_353553205ccd3be47e3ac48c26dbfded.jpg not downloaded yet
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_832dc518d81bac74dc5080c2c05035f0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_96f42b61aa548ba150395f9b38b5659d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg not downloaded yet
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD74245> (referer: https://www.auto1.com/v1/car-details-view/BD74245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL07637> (referer: https://www.auto1.com/v1/car-details-view/ZL07637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_35f39203ae9e23c008e6907418e6d7ac.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_353553205ccd3be47e3ac48c26dbfded.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293d210>
2026-01-28 17:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg saved to cache
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62893b50>
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_832dc518d81bac74dc5080c2c05035f0.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_832dc518d81bac74dc5080c2c05035f0.jpg saved to cache
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a01010>
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_96f42b61aa548ba150395f9b38b5659d.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_96f42b61aa548ba150395f9b38b5659d.jpg saved to cache
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with identifier: BD74245
2026-01-28 17:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with scrape type 2
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with scrape type 2
2026-01-28 17:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cf7ba270-b78c-5065-a79e-6c25d2dc0ed7, identifier: BD74245
2026-01-28 17:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc7417d-ec2a-528d-b672-b503e9949f71 with identifier: ZL07637
2026-01-28 17:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc7417d-ec2a-528d-b672-b503e9949f71 with scrape type 2
2026-01-28 17:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc7417d-ec2a-528d-b672-b503e9949f71 with scrape type 2
2026-01-28 17:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffc7417d-ec2a-528d-b672-b503e9949f71, identifier: ZL07637
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f8710>
2026-01-28 17:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_35f39203ae9e23c008e6907418e6d7ac.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_35f39203ae9e23c008e6907418e6d7ac.jpg saved to cache
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6363af90>
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg saved to cache
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6265d310>
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_353553205ccd3be47e3ac48c26dbfded.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_353553205ccd3be47e3ac48c26dbfded.jpg saved to cache
2026-01-28 17:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with identifier: BD74245
2026-01-28 17:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with identifier: BD74245
2026-01-28 17:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cf7ba270-b78c-5065-a79e-6c25d2dc0ed7 with identifier: BD74245 to the API
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BD74245>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 224,
 'expiration_date': '2026-01-29T16:25:24Z',
 'fuel_type': 'hybrid',
 'id': 'cf7ba270-b78c-5065-a79e-6c25d2dc0ed7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD74245',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 85903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 225 Allure',
 'transmission': 'automatic',
 'trim': '225 Allure',
 'year': 2020}
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD74245%27 HTTP/1.1" 200 None
2026-01-28 17:05:57 [auto1.es] INFO: Saving data for BD74245: {'auction_closing_time': 1769703924.0, 'created_time': 1769014975.550227, 'last_price_update_time': 1769619957.9835}
2026-01-28 17:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BD74245') HTTP/1.1" 204 0
2026-01-28 17:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffc7417d-ec2a-528d-b672-b503e9949f71 with identifier: ZL07637
2026-01-28 17:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffc7417d-ec2a-528d-b672-b503e9949f71 with identifier: ZL07637
2026-01-28 17:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds7 crossback 1.2 puretech performance line', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds7 crossback', 'transmission': 'automatic', 'odometer': 89369, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zl07637', 'expiration_date': '2026-01-29t16:30:43z', 'origin_country_code': 'es', 'trim': 'performance line', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ffc7417d-ec2a-528d-b672-b503e9949f71', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'ds automobiles ds7 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 89369}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:30:43z',
     'fuel_type': 'petrol',
     'id': 'ffc7417d-ec2a-528d-b672-b503e9949f71',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zl07637',
     'listing': 'auction',
     'location': 'es',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds7 crossback',
     'model': 'ds7 crossback',
     'odometer': 89369,
     'odometer_in_km': 89369,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-08',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds7 crossback 1.2 puretech performance line',
     'transmission': 'automatic',
     'trim': 'performance line',
     'year': 2021}
2026-01-28 17:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ffc7417d-ec2a-528d-b672-b503e9949f71 spider: auto1.es
2026-01-28 17:05:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ffc7417d-ec2a-528d-b672-b503e9949f71 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'ds automobiles ds7 crossback 1.2 puretech performance line', 'price': 0, 'currency': 'eur', 'make': 'ds automobiles', 'model': 'ds7 crossback', 'transmission': 'automatic', 'odometer': 89369, 'odometer_reading_unit': 'km', 'registration_date': '2021-04-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zl07637', 'expiration_date': '2026-01-29t16:30:43z', 'origin_country_code': 'es', 'trim': 'performance line', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'ffc7417d-ec2a-528d-b672-b503e9949f71', 'current_year_diff': 5, 'age_in_months': 57, 'make_model': 'ds automobiles ds7 crossback', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 89369}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 57,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:30:43z',
     'fuel_type': 'petrol',
     'id': 'ffc7417d-ec2a-528d-b672-b503e9949f71',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zl07637',
     'listing': 'auction',
     'location': 'es',
     'make': 'ds automobiles',
     'make_model': 'ds automobiles ds7 crossback',
     'model': 'ds7 crossback',
     'odometer': 89369,
     'odometer_in_km': 89369,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2021-04-08',
     'sanitized_make': 'dsautomobiles',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ds automobiles ds7 crossback 1.2 puretech performance line',
     'transmission': 'automatic',
     'trim': 'performance line',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:30:43Z',
 'fuel_type': 'petrol',
 'id': 'ffc7417d-ec2a-528d-b672-b503e9949f71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL07637',
 'listing': 'auction',
 'location': 'ES',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 89369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.2 PureTech Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2021}
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL07637%27 HTTP/1.1" 200 None
2026-01-28 17:05:58 [auto1.es] INFO: Saving data for ZL07637: {'auction_closing_time': 1769704243.0, 'created_time': 1769003165.652832, 'last_price_update_time': 1769619958.213968}
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL07637') HTTP/1.1" 204 0
2026-01-28 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KF67108> (referer: https://www.auto1.com/v1/car-details-view/KF67108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB59452> (referer: https://www.auto1.com/v1/car-details-view/TB59452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6261d350>
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg saved to cache
2026-01-28 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282e0d0>
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg saved to cache
2026-01-28 17:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6274b790>
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg') HTTP/1.1" 204 0
2026-01-28 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg saved to cache
2026-01-28 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_189e20aa82d811a59b76d35b9a83c328.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-01-28 17:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with scrape type 2
2026-01-28 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with scrape type 2
2026-01-28 17:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7, identifier: KF67108
2026-01-28 17:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-01-28 17:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cf16034-9085-51d9-bcca-dee34e271e2f with scrape type 2
2026-01-28 17:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cf16034-9085-51d9-bcca-dee34e271e2f with scrape type 2
2026-01-28 17:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9cf16034-9085-51d9-bcca-dee34e271e2f, identifier: TB59452
2026-01-28 17:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-01-28 17:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108
2026-01-28 17:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7 with identifier: KF67108 to the API
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KF67108>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:24:05Z',
 'fuel_type': 'diesel',
 'id': '982d4c0c-7a7d-5aeb-9501-34bb1f82c1e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF67108',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 104328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid R-dynamic S',
 'transmission': 'automatic',
 'trim': 'R-dynamic S',
 'year': 2020}
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KF67108%27 HTTP/1.1" 200 None
2026-01-28 17:05:59 [auto1.es] INFO: Saving data for KF67108: {'auction_closing_time': 1769703845.0, 'created_time': 1768410193.431679, 'last_price_update_time': 1769619959.534701}
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KF67108') HTTP/1.1" 204 0
2026-01-28 17:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-01-28 17:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452
2026-01-28 17:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9cf16034-9085-51d9-bcca-dee34e271e2f with identifier: TB59452 to the API
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TB59452>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 381,
 'expiration_date': '2026-01-29T16:19:06Z',
 'fuel_type': 'hybrid',
 'id': '9cf16034-9085-51d9-bcca-dee34e271e2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB59452',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 eHybrid Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2020}
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB59452%27 HTTP/1.1" 200 None
2026-01-28 17:05:59 [auto1.es] INFO: Saving data for TB59452: {'auction_closing_time': 1769703546.0, 'created_time': 1769101433.708202, 'last_price_update_time': 1769619959.854715}
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB59452') HTTP/1.1" 204 0
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_001960dc251550845b37526226603ab6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RK21190> (referer: https://www.auto1.com/v1/car-details-view/RK21190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF63413> (referer: https://www.auto1.com/v1/car-details-view/EF63413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT87385> (referer: https://www.auto1.com/v1/car-details-view/VT87385/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL71949> (referer: https://www.auto1.com/v1/car-details-view/ZL71949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628875d0>
2026-01-28 17:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_189e20aa82d811a59b76d35b9a83c328.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_189e20aa82d811a59b76d35b9a83c328.jpg saved to cache
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6363b550>
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg saved to cache
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:06:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:00 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63382910>
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd9%252Fdd%252Fd9ddce9a7d12faa6df348ede81d2291a%252Fpa%252FVX60212_001960dc251550845b37526226603ab6.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_001960dc251550845b37526226603ab6.jpg saved to cache
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6
2026-01-28 17:06:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6, skipping ID generation
2026-01-28 17:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with scrape type 1
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 from tracking dictionaries
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 sending to next pipeline
2026-01-28 17:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6, identifier: VX60212
2026-01-28 17:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-01-28 17:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db859014-01ba-506b-bf96-376eb802ea25 with scrape type 2
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db859014-01ba-506b-bf96-376eb802ea25 with scrape type 2
2026-01-28 17:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db859014-01ba-506b-bf96-376eb802ea25, identifier: RK21190
2026-01-28 17:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with identifier: EF63413
2026-01-28 17:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with scrape type 2
2026-01-28 17:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with scrape type 2
2026-01-28 17:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f0ac30a-65c2-580c-b07c-dd4faa438b11, identifier: EF63413
2026-01-28 17:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee738a67-1b06-5637-84b6-bcf5886130ef with identifier: VT87385
2026-01-28 17:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee738a67-1b06-5637-84b6-bcf5886130ef with scrape type 2
2026-01-28 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee738a67-1b06-5637-84b6-bcf5886130ef with scrape type 2
2026-01-28 17:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee738a67-1b06-5637-84b6-bcf5886130ef, identifier: VT87385
2026-01-28 17:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with identifier: ZL71949
2026-01-28 17:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with scrape type 2
2026-01-28 17:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with scrape type 2
2026-01-28 17:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 37c79669-5f41-51bd-a12b-c4b2ffdef9b4, identifier: ZL71949
2026-01-28 17:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with identifier: VX60212
2026-01-28 17:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with identifier: VX60212
2026-01-28 17:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6 with identifier: VX60212 to the API
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_001960dc251550845b37526226603ab6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:37:08Z',
 'fuel_type': 'diesel',
 'id': '9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX60212',
 'listing': 'auction',
 'location': 'ES, Puerto de Santa María',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 86556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c54d0173f2b2ce51944eb87261262d09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_354105b823aca7839049df9e07242bc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_001960dc251550845b37526226603ab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_189e20aa82d811a59b76d35b9a83c328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_6ca23810310376eb9fd2cb2dd40393aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_c7d238fa9b4818f72bc096f4ef729e7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_9c8eb1a99cbc735b518a0cc3b448fa49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0e76861fb7457366546fc0a50215a23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_0841cf2c5e6a30f08dc01a2a64fc6b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_96f42b61aa548ba150395f9b38b5659d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_ca7d73d94fbd5173c87470f7b491b2f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_832dc518d81bac74dc5080c2c05035f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_35f39203ae9e23c008e6907418e6d7ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_8da7e89ce865bd15af3f7c2f76b5217f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_353553205ccd3be47e3ac48c26dbfded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6/9b8c3fe5-efa5-5aaa-88e8-de13737fe8f6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd9/dd/d9ddce9a7d12faa6df348ede81d2291a/pa/VX60212_137f8d418a62a57ec6a531f1b54c4bee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 250 d 4Matic Doppelkabine Power',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Power',
 'year': 2018}
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VX60212%27 HTTP/1.1" 200 None
2026-01-28 17:06:01 [auto1.es] INFO: Saving data for VX60212: {'created_time': 1769619961.569743, 'last_price_update_time': 1769619961.569755, 'auction_closing_time': 1769704628.0}
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VX60212') HTTP/1.1" 204 0
2026-01-28 17:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-01-28 17:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db859014-01ba-506b-bf96-376eb802ea25 with identifier: RK21190
2026-01-28 17:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134851 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134851
2026-01-28 17:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: db859014-01ba-506b-bf96-376eb802ea25 spider: auto1.es
2026-01-28 17:06:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: db859014-01ba-506b-bf96-376eb802ea25 due to rule: high_mileage_for_make.json, error: 134851 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134851
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:47:29Z',
 'fuel_type': 'diesel',
 'id': 'db859014-01ba-506b-bf96-376eb802ea25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK21190',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 134851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RK21190%27 HTTP/1.1" 200 None
2026-01-28 17:06:01 [auto1.es] INFO: Saving data for RK21190: {'auction_closing_time': 1769705249.0, 'created_time': 1768410297.291355, 'last_price_update_time': 1769619961.789141}
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RK21190') HTTP/1.1" 204 0
2026-01-28 17:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with identifier: EF63413
2026-01-28 17:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with identifier: EF63413
2026-01-28 17:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2f0ac30a-65c2-580c-b07c-dd4faa438b11 with identifier: EF63413 to the API
2026-01-28 17:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF63413>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:55Z',
 'fuel_type': 'petrol',
 'id': '2f0ac30a-65c2-580c-b07c-dd4faa438b11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF63413',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 58378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF63413%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Saving data for EF63413: {'auction_closing_time': 1769703355.0, 'created_time': 1769003153.747478, 'last_price_update_time': 1769619962.146972}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF63413') HTTP/1.1" 204 0
2026-01-28 17:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee738a67-1b06-5637-84b6-bcf5886130ef with identifier: VT87385
2026-01-28 17:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee738a67-1b06-5637-84b6-bcf5886130ef with identifier: VT87385
2026-01-28 17:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee738a67-1b06-5637-84b6-bcf5886130ef with identifier: VT87385 to the API
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VT87385>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:13:33Z',
 'fuel_type': 'electro',
 'id': 'ee738a67-1b06-5637-84b6-bcf5886130ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT87385',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 125 kW Pure Performance',
 'transmission': 'automatic',
 'trim': 'Pure Performance',
 'year': 2022}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT87385%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Saving data for VT87385: {'auction_closing_time': 1769703213.0, 'created_time': 1768928448.1389, 'last_price_update_time': 1769619962.475607}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT87385') HTTP/1.1" 204 0
2026-01-28 17:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with identifier: ZL71949
2026-01-28 17:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with identifier: ZL71949
2026-01-28 17:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 37c79669-5f41-51bd-a12b-c4b2ffdef9b4 with identifier: ZL71949 to the API
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL71949>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:40:58Z',
 'fuel_type': 'diesel',
 'id': '37c79669-5f41-51bd-a12b-c4b2ffdef9b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL71949',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 100578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2020}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL71949%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Saving data for ZL71949: {'auction_closing_time': 1769704858.0, 'created_time': 1768457026.386301, 'last_price_update_time': 1769619962.810137}
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL71949') HTTP/1.1" 204 0
2026-01-28 17:06:02 [auto1.es] INFO: Found listing with ID: XZ84742
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Scrape type for XZ84742: 2
2026-01-28 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH32569> (referer: https://www.auto1.com/v1/car-details-view/CH32569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK65705> (referer: https://www.auto1.com/v1/car-details-view/HK65705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS82424/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_ea1074d8604925f864a28740676d0f0d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:02 [auto1.es] INFO: Found listing with ID: AG21030
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG21030%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Scrape type for AG21030: 2
2026-01-28 17:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:02 [auto1.es] INFO: Found listing with ID: NW76363
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW76363%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Scrape type for NW76363: 2
2026-01-28 17:06:02 [auto1.es] INFO: Found listing with ID: VG50719
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG50719%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Scrape type for VG50719: 2
2026-01-28 17:06:02 [auto1.es] INFO: Found listing with ID: MG31491
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG31491%27 HTTP/1.1" 200 None
2026-01-28 17:06:02 [auto1.es] INFO: Scrape type for MG31491: 2
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63489cd0>
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg saved to cache
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860635f1-3bb4-588d-8367-ecef8bb40588 with identifier: CH32569
2026-01-28 17:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860635f1-3bb4-588d-8367-ecef8bb40588 with scrape type 2
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 860635f1-3bb4-588d-8367-ecef8bb40588 with scrape type 2
2026-01-28 17:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 860635f1-3bb4-588d-8367-ecef8bb40588, identifier: CH32569
2026-01-28 17:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-01-28 17:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with scrape type 2
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with scrape type 2
2026-01-28 17:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c89d5b0-b366-53a0-929c-486f3a51c5d7, identifier: HK65705
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f4f50>
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_ea1074d8604925f864a28740676d0f0d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_ea1074d8604925f864a28740676d0f0d.jpg saved to cache
2026-01-28 17:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:06:03 [auto1.es] INFO: Found listing with ID: GH68553
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH68553%27 HTTP/1.1" 200 None
2026-01-28 17:06:03 [auto1.es] INFO: Scrape type for GH68553: 1
2026-01-28 17:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 860635f1-3bb4-588d-8367-ecef8bb40588 with identifier: CH32569
2026-01-28 17:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 860635f1-3bb4-588d-8367-ecef8bb40588 with identifier: CH32569
2026-01-28 17:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 860635f1-3bb4-588d-8367-ecef8bb40588 with identifier: CH32569 to the API
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CH32569>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:38:47Z',
 'fuel_type': 'diesel',
 'id': '860635f1-3bb4-588d-8367-ecef8bb40588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH32569',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 100277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH32569%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Saving data for CH32569: {'auction_closing_time': 1769704727.0, 'created_time': 1768410442.142004, 'last_price_update_time': 1769619964.029131}
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH32569') HTTP/1.1" 204 0
2026-01-28 17:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-01-28 17:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705
2026-01-28 17:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5c89d5b0-b366-53a0-929c-486f3a51c5d7 with identifier: HK65705 to the API
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK65705>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:44:03Z',
 'fuel_type': 'diesel',
 'id': '5c89d5b0-b366-53a0-929c-486f3a51c5d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK65705',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '3er',
 'odometer': 138942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2022}
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK65705%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Saving data for HK65705: {'auction_closing_time': 1769705043.0, 'created_time': 1768410211.712617, 'last_price_update_time': 1769619964.320791}
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK65705') HTTP/1.1" 204 0
2026-01-28 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: FG75667
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG75667%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for FG75667: 2
2026-01-28 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY44668> (referer: https://www.auto1.com/v1/car-details-view/HY44668/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT38971> (referer: https://www.auto1.com/v1/car-details-view/KT38971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV41584> (referer: https://www.auto1.com/v1/car-details-view/BV41584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF74098> (referer: https://www.auto1.com/v1/car-details-view/LF74098/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: NA81137
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA81137%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for NA81137: 2
2026-01-28 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: JU00551
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU00551%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for JU00551: 2
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: EV17776
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV17776%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for EV17776: 2
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: CW26445
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW26445%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for CW26445: 2
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: CV02777
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV02777%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for CV02777: 2
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627be050>
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg saved to cache
2026-01-28 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:06:04 [scrapy.extensions.logstats] INFO: Crawled 861 pages (at 165 pages/min), scraped 235 items (at 46 items/min)
2026-01-28 17:06:04 [auto1.es] INFO: Found listing with ID: MA44811
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA44811%27 HTTP/1.1" 200 None
2026-01-28 17:06:04 [auto1.es] INFO: Scrape type for MA44811: 1
2026-01-28 17:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc8985ca-78e6-538b-843b-0c34d3a5fb1a with identifier: HY44668
2026-01-28 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc8985ca-78e6-538b-843b-0c34d3a5fb1a with scrape type 2
2026-01-28 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc8985ca-78e6-538b-843b-0c34d3a5fb1a with scrape type 2
2026-01-28 17:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bc8985ca-78e6-538b-843b-0c34d3a5fb1a, identifier: HY44668
2026-01-28 17:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-01-28 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0158f513-a5a7-5ae0-b679-c145cb20e453 with scrape type 2
2026-01-28 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0158f513-a5a7-5ae0-b679-c145cb20e453 with scrape type 2
2026-01-28 17:06:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0158f513-a5a7-5ae0-b679-c145cb20e453, identifier: KT38971
2026-01-28 17:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b339720-fa78-54ab-8629-c3ae897c2064 with identifier: BV41584
2026-01-28 17:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b339720-fa78-54ab-8629-c3ae897c2064 with scrape type 2
2026-01-28 17:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b339720-fa78-54ab-8629-c3ae897c2064 with scrape type 2
2026-01-28 17:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2b339720-fa78-54ab-8629-c3ae897c2064, identifier: BV41584
2026-01-28 17:06:05 [auto1.es] INFO: Found listing with ID: SH03418
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-01-28 17:06:05 [auto1.es] INFO: Scrape type for SH03418: 1
2026-01-28 17:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bc8985ca-78e6-538b-843b-0c34d3a5fb1a with identifier: HY44668
2026-01-28 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bc8985ca-78e6-538b-843b-0c34d3a5fb1a with identifier: HY44668
2026-01-28 17:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bc8985ca-78e6-538b-843b-0c34d3a5fb1a with identifier: HY44668 to the API
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY44668>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 272,
 'expiration_date': '2026-01-29T16:07:55Z',
 'fuel_type': 'petrol',
 'id': 'bc8985ca-78e6-538b-843b-0c34d3a5fb1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY44668',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 103716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY44668%27 HTTP/1.1" 200 None
2026-01-28 17:06:05 [auto1.es] INFO: Saving data for HY44668: {'auction_closing_time': 1769702875.0, 'created_time': 1769162616.75836, 'last_price_update_time': 1769619965.371661}
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HY44668') HTTP/1.1" 204 0
2026-01-28 17:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-01-28 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971
2026-01-28 17:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0158f513-a5a7-5ae0-b679-c145cb20e453 with identifier: KT38971 to the API
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KT38971>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-01-29T16:08:09Z',
 'fuel_type': 'hybrid',
 'id': '0158f513-a5a7-5ae0-b679-c145cb20e453',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT38971',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 24969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Countryman Cooper SE ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2023}
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KT38971%27 HTTP/1.1" 200 None
2026-01-28 17:06:05 [auto1.es] INFO: Saving data for KT38971: {'auction_closing_time': 1769702889.0, 'created_time': 1768410281.153041, 'last_price_update_time': 1769619965.816337}
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KT38971') HTTP/1.1" 204 0
2026-01-28 17:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2b339720-fa78-54ab-8629-c3ae897c2064 with identifier: BV41584
2026-01-28 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2b339720-fa78-54ab-8629-c3ae897c2064 with identifier: BV41584
2026-01-28 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
2026-01-28 17:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2b339720-fa78-54ab-8629-c3ae897c2064 spider: auto1.es
2026-01-28 17:06:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2b339720-fa78-54ab-8629-c3ae897c2064 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'vivaro' containing 'vivaro'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:51:06Z',
 'fuel_type': 'diesel',
 'id': '2b339720-fa78-54ab-8629-c3ae897c2064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV41584',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 103818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI Pack Clim M (L2)',
 'transmission': 'manual',
 'trim': 'Pack Clim M (L2)',
 'year': 2020}
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV41584%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Saving data for BV41584: {'auction_closing_time': 1769705466.0, 'created_time': 1768410201.924216, 'last_price_update_time': 1769619966.110295}
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BV41584') HTTP/1.1" 204 0
2026-01-28 17:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b9cafb3-bc08-5337-aba8-d998719e41aa with identifier: LF74098
2026-01-28 17:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b9cafb3-bc08-5337-aba8-d998719e41aa with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b9cafb3-bc08-5337-aba8-d998719e41aa with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3b9cafb3-bc08-5337-aba8-d998719e41aa, identifier: LF74098
2026-01-28 17:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3b9cafb3-bc08-5337-aba8-d998719e41aa with identifier: LF74098
2026-01-28 17:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3b9cafb3-bc08-5337-aba8-d998719e41aa with identifier: LF74098
2026-01-28 17:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3b9cafb3-bc08-5337-aba8-d998719e41aa with identifier: LF74098 to the API
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF74098>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:09:19Z',
 'fuel_type': 'diesel',
 'id': '3b9cafb3-bc08-5337-aba8-d998719e41aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF74098',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 135968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2020}
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF74098%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Saving data for LF74098: {'auction_closing_time': 1769702959.0, 'created_time': 1768410295.487245, 'last_price_update_time': 1769619966.525724}
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LF74098') HTTP/1.1" 204 0
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: HB41408
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB41408%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for HB41408: 2
2026-01-28 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN08712> (referer: https://www.auto1.com/v1/car-details-view/DN08712/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA70803> (referer: https://www.auto1.com/v1/car-details-view/PA70803/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG13675> (referer: https://www.auto1.com/v1/car-details-view/DG13675/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: NB20063
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NB20063%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for NB20063: 0
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: VB61319
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB61319%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for VB61319: 2
2026-01-28 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY35323/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: GK53380
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for GK53380: 2
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: EK01872
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK01872%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for EK01872: 2
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: DS85202
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS85202%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for DS85202: 2
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: EN27653
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN27653%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for EN27653: 2
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: GM17257
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM17257%27 HTTP/1.1" 200 None
2026-01-28 17:06:06 [auto1.es] INFO: Scrape type for GM17257: 2
2026-01-28 17:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d7a472-d028-54f8-9bd6-74c27fcf43eb with identifier: DN08712
2026-01-28 17:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d7a472-d028-54f8-9bd6-74c27fcf43eb with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38d7a472-d028-54f8-9bd6-74c27fcf43eb with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 38d7a472-d028-54f8-9bd6-74c27fcf43eb, identifier: DN08712
2026-01-28 17:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5affa05c-a487-58d6-a358-e8ffe132e3f1 with identifier: PA70803
2026-01-28 17:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5affa05c-a487-58d6-a358-e8ffe132e3f1 with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5affa05c-a487-58d6-a358-e8ffe132e3f1 with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5affa05c-a487-58d6-a358-e8ffe132e3f1, identifier: PA70803
2026-01-28 17:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d967ac3-301d-5729-8623-b48cd744fb84 with identifier: DG13675
2026-01-28 17:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d967ac3-301d-5729-8623-b48cd744fb84 with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d967ac3-301d-5729-8623-b48cd744fb84 with scrape type 2
2026-01-28 17:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d967ac3-301d-5729-8623-b48cd744fb84, identifier: DG13675
2026-01-28 17:06:06 [auto1.es] INFO: Found listing with ID: PC27245
2026-01-28 17:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC27245%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for PC27245: 2
2026-01-28 17:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 38d7a472-d028-54f8-9bd6-74c27fcf43eb with identifier: DN08712
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 38d7a472-d028-54f8-9bd6-74c27fcf43eb with identifier: DN08712
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 125561, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn08712', 'expiration_date': '2026-01-29t16:25:36z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '38d7a472-d028-54f8-9bd6-74c27fcf43eb', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 125561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:36z',
     'fuel_type': 'petrol',
     'id': '38d7a472-d028-54f8-9bd6-74c27fcf43eb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn08712',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 125561,
     'odometer_in_km': 125561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 38d7a472-d028-54f8-9bd6-74c27fcf43eb spider: auto1.es
2026-01-28 17:06:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 38d7a472-d028-54f8-9bd6-74c27fcf43eb due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 125561, 'odometer_reading_unit': 'km', 'registration_date': '2018-07-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn08712', 'expiration_date': '2026-01-29t16:25:36z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '38d7a472-d028-54f8-9bd6-74c27fcf43eb', 'current_year_diff': 8, 'age_in_months': 90, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 125561}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:25:36z',
     'fuel_type': 'petrol',
     'id': '38d7a472-d028-54f8-9bd6-74c27fcf43eb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dn08712',
     'listing': 'auction',
     'location': 'es',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 125561,
     'odometer_in_km': 125561,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-07-08',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:25:36Z',
 'fuel_type': 'petrol',
 'id': '38d7a472-d028-54f8-9bd6-74c27fcf43eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN08712',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 125561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2018}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN08712%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Saving data for DN08712: {'auction_closing_time': 1769703936.0, 'created_time': 1768928588.835213, 'last_price_update_time': 1769619967.220074}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DN08712') HTTP/1.1" 204 0
2026-01-28 17:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5affa05c-a487-58d6-a358-e8ffe132e3f1 with identifier: PA70803
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5affa05c-a487-58d6-a358-e8ffe132e3f1 with identifier: PA70803
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5affa05c-a487-58d6-a358-e8ffe132e3f1 spider: auto1.es
2026-01-28 17:06:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5affa05c-a487-58d6-a358-e8ffe132e3f1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:16:38Z',
 'fuel_type': 'diesel',
 'id': '5affa05c-a487-58d6-a358-e8ffe132e3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA70803',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 190642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA70803%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Saving data for PA70803: {'auction_closing_time': 1769703398.0, 'created_time': 1769061748.228362, 'last_price_update_time': 1769619967.454174}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PA70803') HTTP/1.1" 204 0
2026-01-28 17:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d967ac3-301d-5729-8623-b48cd744fb84 with identifier: DG13675
2026-01-28 17:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d967ac3-301d-5729-8623-b48cd744fb84 with identifier: DG13675
2026-01-28 17:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d967ac3-301d-5729-8623-b48cd744fb84 with identifier: DG13675 to the API
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG13675>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:01:39Z',
 'fuel_type': 'diesel',
 'id': '6d967ac3-301d-5729-8623-b48cd744fb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG13675',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 143923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DG13675%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Saving data for DG13675: {'auction_closing_time': 1769702499.0, 'created_time': 1768410382.668792, 'last_price_update_time': 1769619967.766958}
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DG13675') HTTP/1.1" 204 0
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: PF38701
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF38701%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for PF38701: 2
2026-01-28 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KB87556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ45268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY84570/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: EY58964
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY58964%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for EY58964: 2
2026-01-28 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: AR26127
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR26127%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for AR26127: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: HZ84403
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for HZ84403: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: RM01009
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM01009%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for RM01009: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: NF79816
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79816%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for NF79816: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: ND01122
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND01122%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for ND01122: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: SL25416
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for SL25416: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: AN08984
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN08984%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for AN08984: 2
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: BL95090
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL95090%27 HTTP/1.1" 200 None
2026-01-28 17:06:07 [auto1.es] INFO: Scrape type for BL95090: 1
2026-01-28 17:06:07 [auto1.es] INFO: Found listing with ID: NF45409
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF45409%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for NF45409: 2
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: KN50898
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50898%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for KN50898: 2
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: DR04580
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR04580%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for DR04580: 1
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: UE26475
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE26475%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for UE26475: 2
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: SG65714
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for SG65714: 2
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: LV49535
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for LV49535: 2
2026-01-28 17:06:08 [auto1.es] INFO: Found listing with ID: ZL23316
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL23316%27 HTTP/1.1" 200 None
2026-01-28 17:06:08 [auto1.es] INFO: Scrape type for ZL23316: 1
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH64101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ84742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FG75667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH68553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MG31491/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS82424> (referer: https://www.auto1.com/v1/car-details-view/NS82424/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 401ae473-984a-5a41-8794-160ac3092a08 with identifier: NS82424
2026-01-28 17:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 401ae473-984a-5a41-8794-160ac3092a08 with scrape type 2
2026-01-28 17:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 401ae473-984a-5a41-8794-160ac3092a08 with scrape type 2
2026-01-28 17:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 401ae473-984a-5a41-8794-160ac3092a08, identifier: NS82424
2026-01-28 17:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 401ae473-984a-5a41-8794-160ac3092a08 with identifier: NS82424
2026-01-28 17:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 401ae473-984a-5a41-8794-160ac3092a08 with identifier: NS82424
2026-01-28 17:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 401ae473-984a-5a41-8794-160ac3092a08 with identifier: NS82424 to the API
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS82424>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:38:34Z',
 'fuel_type': 'diesel',
 'id': '401ae473-984a-5a41-8794-160ac3092a08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS82424',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 100613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NS82424%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Saving data for NS82424: {'auction_closing_time': 1769704714.0, 'created_time': 1769148209.260983, 'last_price_update_time': 1769619969.588055}
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NS82424') HTTP/1.1" 204 0
2026-01-28 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH03418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA44811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG50719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: LX91241
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX91241%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for LX91241: 1
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: XF05648
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF05648%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for XF05648: 1
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: NG68284
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG68284%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for NG68284: 1
2026-01-28 17:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB41408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: XZ16571
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for XZ16571: 2
2026-01-28 17:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: KU77979
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU77979%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for KU77979: 2
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: RZ25182
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for RZ25182: 2
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: SY95486
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY95486%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for SY95486: 2
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: WR98337
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR98337%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for WR98337: 2
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: EY27652
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY27652%27 HTTP/1.1" 200 None
2026-01-28 17:06:09 [auto1.es] INFO: Scrape type for EY27652: 2
2026-01-28 17:06:09 [auto1.es] INFO: Found listing with ID: AF70499
2026-01-28 17:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF70499%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for AF70499: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: LV66931
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV66931%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for LV66931: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: GN42445
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN42445%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for GN42445: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: TY04306
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY04306%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for TY04306: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: ZP90682
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP90682%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for ZP90682: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: UZ13447
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for UZ13447: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: ES71319
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES71319%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for ES71319: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: PB23846
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for PB23846: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: CL61096
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL61096%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for CL61096: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: GU10653
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU10653%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for GU10653: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: UX61881
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX61881%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for UX61881: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: ZG30508
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG30508%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for ZG30508: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: PD89077
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD89077%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for PD89077: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: HG47360
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47360%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for HG47360: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: PM05949
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM05949%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for PM05949: 1
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: EM36391
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM36391%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for EM36391: 1
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: BJ25544
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ25544%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for BJ25544: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: FU92105
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU92105%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for FU92105: 1
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV02777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: LF16630
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF16630%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for LF16630: 2
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: XJ12820
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for XJ12820: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: NK39873
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK39873%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for NK39873: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: UW92263
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UW92263%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for UW92263: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: YY55066
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY55066%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for YY55066: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: NJ80936
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ80936%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for NJ80936: 2
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PC27245/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: JG49052
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG49052%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for JG49052: 2
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: BP86334
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP86334%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for BP86334: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: XX30070
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX30070%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for XX30070: 1
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: RJ22818
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ22818%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for RJ22818: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: VY28267
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for VY28267: 1
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: DF95857
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95857%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for DF95857: 2
2026-01-28 17:06:10 [auto1.es] INFO: Found listing with ID: FW12550
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW12550%27 HTTP/1.1" 200 None
2026-01-28 17:06:10 [auto1.es] INFO: Scrape type for FW12550: 2
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY38969/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PF38701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL23316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV49535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM17257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ84742> (referer: https://www.auto1.com/v1/car-details-view/XZ84742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-01-28 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04951d82-0d29-5df2-bc34-5646d9cb67af with scrape type 2
2026-01-28 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04951d82-0d29-5df2-bc34-5646d9cb67af with scrape type 2
2026-01-28 17:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04951d82-0d29-5df2-bc34-5646d9cb67af, identifier: XZ84742
2026-01-28 17:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-01-28 17:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742
2026-01-28 17:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 04951d82-0d29-5df2-bc34-5646d9cb67af with identifier: XZ84742 to the API
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ84742>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:09:59Z',
 'fuel_type': 'diesel',
 'id': '04951d82-0d29-5df2-bc34-5646d9cb67af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ84742',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 121085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ84742%27 HTTP/1.1" 200 None
2026-01-28 17:06:11 [auto1.es] INFO: Saving data for XZ84742: {'auction_closing_time': 1769702999.0, 'created_time': 1768401558.225565, 'last_price_update_time': 1769619971.63088}
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ84742') HTTP/1.1" 204 0
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH64101> (referer: https://www.auto1.com/v1/car-details-view/TH64101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FG75667> (referer: https://www.auto1.com/v1/car-details-view/FG75667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG65714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH68553> (referer: https://www.auto1.com/v1/car-details-view/GH68553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MG31491> (referer: https://www.auto1.com/v1/car-details-view/MG31491/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR04580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with identifier: TH64101
2026-01-28 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with scrape type 2
2026-01-28 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with scrape type 2
2026-01-28 17:06:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7, identifier: TH64101
2026-01-28 17:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with identifier: FG75667
2026-01-28 17:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with scrape type 2
2026-01-28 17:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with scrape type 2
2026-01-28 17:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 036f2a04-67e0-5a7d-a824-a7a708b3b3b2, identifier: FG75667
2026-01-28 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with identifier: GH68553
2026-01-28 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with scrape type 1
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg not downloaded yet
2026-01-28 17:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with identifier: TH64101
2026-01-28 17:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with identifier: TH64101
2026-01-28 17:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 20d8f2cf-70f8-59e3-94f5-05c5ac4797f7 with identifier: TH64101 to the API
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TH64101>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:39:43Z',
 'fuel_type': 'petrol',
 'id': '20d8f2cf-70f8-59e3-94f5-05c5ac4797f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH64101',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 125439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH64101%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [auto1.es] INFO: Saving data for TH64101: {'auction_closing_time': 1769704783.0, 'created_time': 1768928580.371456, 'last_price_update_time': 1769619972.389321}
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH64101') HTTP/1.1" 204 0
2026-01-28 17:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with identifier: FG75667
2026-01-28 17:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with identifier: FG75667
2026-01-28 17:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 036f2a04-67e0-5a7d-a824-a7a708b3b3b2 with identifier: FG75667 to the API
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FG75667>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:17:35Z',
 'fuel_type': 'diesel',
 'id': '036f2a04-67e0-5a7d-a824-a7a708b3b3b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75667',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 114306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2020}
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FG75667%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [auto1.es] INFO: Saving data for FG75667: {'auction_closing_time': 1769703455.0, 'created_time': 1768401424.363771, 'last_price_update_time': 1769619972.714669}
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FG75667') HTTP/1.1" 204 0
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_9333c8992b206627855f5843341e64d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9333c8992b206627855f5843341e64d9.jpg not downloaded yet
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_a1b15e471f23909d02e63f6eb17748e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a1b15e471f23909d02e63f6eb17748e5.jpg not downloaded yet
2026-01-28 17:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with identifier: MG31491
2026-01-28 17:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with scrape type 2
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with scrape type 2
2026-01-28 17:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c, identifier: MG31491
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_8ec732905116e475419e2e1553e4033d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_8ec732905116e475419e2e1553e4033d.jpg not downloaded yet
2026-01-28 17:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with identifier: MG31491
2026-01-28 17:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with identifier: MG31491
2026-01-28 17:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c with identifier: MG31491 to the API
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MG31491>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:00:45Z',
 'fuel_type': 'petrol',
 'id': '65c4ac6f-7b3f-53b9-8ce6-1cfb014c8e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG31491',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 83927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG31491%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [auto1.es] INFO: Saving data for MG31491: {'auction_closing_time': 1769702445.0, 'created_time': 1769447444.413984, 'last_price_update_time': 1769619976.28504}
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MG31491') HTTP/1.1" 204 0
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_a2645b3d4235f4f4da2f9149d1786151.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a2645b3d4235f4f4da2f9149d1786151.jpg not downloaded yet
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG68284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE26475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg not downloaded yet
2026-01-28 17:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_9c02dca13a701ec9540eef8d48c51d52.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9c02dca13a701ec9540eef8d48c51d52.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_23b5284536a7ef07f5b4853515176cf8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23b5284536a7ef07f5b4853515176cf8.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_099dc1f582e21c59b099a07f1dda1b27.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_099dc1f582e21c59b099a07f1dda1b27.jpg not downloaded yet
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_0ac12944cde5555951972aeb787b2a1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0ac12944cde5555951972aeb787b2a1b.jpg not downloaded yet
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a2645b3d4235f4f4da2f9149d1786151.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_8ec732905116e475419e2e1553e4033d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e7d10>
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_a2645b3d4235f4f4da2f9149d1786151.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a2645b3d4235f4f4da2f9149d1786151.jpg saved to cache
2026-01-28 17:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_099dc1f582e21c59b099a07f1dda1b27.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0ac12944cde5555951972aeb787b2a1b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ80936/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU92105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626429d0>
2026-01-28 17:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_8ec732905116e475419e2e1553e4033d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_8ec732905116e475419e2e1553e4033d.jpg saved to cache
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF95857/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW12550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY28267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6364e250>
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_099dc1f582e21c59b099a07f1dda1b27.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_099dc1f582e21c59b099a07f1dda1b27.jpg saved to cache
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63519650>
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_0ac12944cde5555951972aeb787b2a1b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0ac12944cde5555951972aeb787b2a1b.jpg saved to cache
2026-01-28 17:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY38969> (referer: https://www.auto1.com/v1/car-details-view/SY38969/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM17257> (referer: https://www.auto1.com/v1/car-details-view/GM17257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a02b50>
2026-01-28 17:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg saved to cache
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62866c10>
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg saved to cache
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a97da0-6c27-5e39-8290-ff70de442fef with identifier: SY38969
2026-01-28 17:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a97da0-6c27-5e39-8290-ff70de442fef with scrape type 2
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a97da0-6c27-5e39-8290-ff70de442fef with scrape type 2
2026-01-28 17:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 13a97da0-6c27-5e39-8290-ff70de442fef, identifier: SY38969
2026-01-28 17:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73eb4b22-5cd4-5cd3-b412-b45b9852349d with identifier: GM17257
2026-01-28 17:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73eb4b22-5cd4-5cd3-b412-b45b9852349d with scrape type 2
2026-01-28 17:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73eb4b22-5cd4-5cd3-b412-b45b9852349d with scrape type 2
2026-01-28 17:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 73eb4b22-5cd4-5cd3-b412-b45b9852349d, identifier: GM17257
2026-01-28 17:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 13a97da0-6c27-5e39-8290-ff70de442fef with identifier: SY38969
2026-01-28 17:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 13a97da0-6c27-5e39-8290-ff70de442fef with identifier: SY38969
2026-01-28 17:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 13a97da0-6c27-5e39-8290-ff70de442fef with identifier: SY38969 to the API
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY38969>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:25:29Z',
 'fuel_type': 'petrol',
 'id': '13a97da0-6c27-5e39-8290-ff70de442fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY38969',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 33739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY38969%27 HTTP/1.1" 200 None
2026-01-28 17:06:18 [auto1.es] INFO: Saving data for SY38969: {'auction_closing_time': 1769703929.0, 'created_time': 1769101938.847816, 'last_price_update_time': 1769619978.95186}
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY38969') HTTP/1.1" 204 0
2026-01-28 17:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 73eb4b22-5cd4-5cd3-b412-b45b9852349d with identifier: GM17257
2026-01-28 17:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 73eb4b22-5cd4-5cd3-b412-b45b9852349d with identifier: GM17257
2026-01-28 17:06:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 73eb4b22-5cd4-5cd3-b412-b45b9852349d with identifier: GM17257 to the API
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM17257>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:31:57Z',
 'fuel_type': 'petrol',
 'id': '73eb4b22-5cd4-5cd3-b412-b45b9852349d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM17257',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 114322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-25',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GM17257%27 HTTP/1.1" 200 None
2026-01-28 17:06:19 [auto1.es] INFO: Saving data for GM17257: {'auction_closing_time': 1769704317.0, 'created_time': 1768401575.130228, 'last_price_update_time': 1769619979.262555}
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GM17257') HTTP/1.1" 204 0
2026-01-28 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23b5284536a7ef07f5b4853515176cf8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9c02dca13a701ec9540eef8d48c51d52.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PC27245> (referer: https://www.auto1.com/v1/car-details-view/PC27245/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6261db90>
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg saved to cache
2026-01-28 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bb810>
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg saved to cache
2026-01-28 17:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62ae65d0>
2026-01-28 17:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg saved to cache
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL23316> (referer: https://www.auto1.com/v1/car-details-view/ZL23316/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV49535> (referer: https://www.auto1.com/v1/car-details-view/LV49535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX30070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PF38701> (referer: https://www.auto1.com/v1/car-details-view/PF38701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP86334/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ22818/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63646650>
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_23b5284536a7ef07f5b4853515176cf8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23b5284536a7ef07f5b4853515176cf8.jpg saved to cache
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a2c490>
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_9c02dca13a701ec9540eef8d48c51d52.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9c02dca13a701ec9540eef8d48c51d52.jpg saved to cache
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e with identifier: PC27245
2026-01-28 17:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae8897f0-a9e1-5125-bce2-f7a88baa9a6e with scrape type 2
2026-01-28 17:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae8897f0-a9e1-5125-bce2-f7a88baa9a6e with scrape type 2
2026-01-28 17:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e, identifier: PC27245
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e with identifier: PC27245
2026-01-28 17:06:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e with identifier: PC27245
2026-01-28 17:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e spider: auto1.es
2026-01-28 17:06:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ae8897f0-a9e1-5125-bce2-f7a88baa9a6e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:29:48Z',
 'fuel_type': 'diesel',
 'id': 'ae8897f0-a9e1-5125-bce2-f7a88baa9a6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC27245',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 138766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2020}
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PC27245%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [auto1.es] INFO: Saving data for PC27245: {'auction_closing_time': 1769704188.0, 'created_time': 1768324055.078799, 'last_price_update_time': 1769619981.169384}
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PC27245') HTTP/1.1" 204 0
2026-01-28 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE26475> (referer: https://www.auto1.com/v1/car-details-view/UE26475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a1b15e471f23909d02e63f6eb17748e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62664910>
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg saved to cache
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f03e892-ef66-5d01-9568-eb3e8e72463c with identifier: ZL23316
2026-01-28 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f03e892-ef66-5d01-9568-eb3e8e72463c with scrape type 1
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0f03e892-ef66-5d01-9568-eb3e8e72463c
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_866b47c51afc2f81a1b6832147196e26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_866b47c51afc2f81a1b6832147196e26.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_74ccfbe6ca3ba431eee977c180658670.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_74ccfbe6ca3ba431eee977c180658670.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_34523a8a1c4673e0e6af62c278676788.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_34523a8a1c4673e0e6af62c278676788.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_0c1d8f786078c44731514fee13ee8848.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_0c1d8f786078c44731514fee13ee8848.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_1f7f93d10431891fe1ffe51136b9cfd8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_1f7f93d10431891fe1ffe51136b9cfd8.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_f2c4546e6e25f0d66203b6ee8f844b1f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f2c4546e6e25f0d66203b6ee8f844b1f.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_4c3c26f5c35d0516ae8779a5991ab823.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_4c3c26f5c35d0516ae8779a5991ab823.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_755245b24ea0c5ba1282f60048e40def.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_755245b24ea0c5ba1282f60048e40def.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_5874457ccb6b8e0acc24d4ba97dc8f1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5874457ccb6b8e0acc24d4ba97dc8f1b.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_f025c5cc47228110a76dd9dfc9893732.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f025c5cc47228110a76dd9dfc9893732.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_caf3b01ea20f10aca34136067245c503.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_caf3b01ea20f10aca34136067245c503.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_5681a66fa6bbc328c179cfa1541e481a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5681a66fa6bbc328c179cfa1541e481a.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_96e7507a21f19ddab60ee51fccb0c4be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_96e7507a21f19ddab60ee51fccb0c4be.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_d94da8a233894307586d88af5008cf4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_d94da8a233894307586d88af5008cf4a.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_2bf18c035d1e23db387553d0cc743f67.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_2bf18c035d1e23db387553d0cc743f67.jpg already downloaded
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F42%252Fdb4214b6e7a84c5947f09ca5fa122e44%252Fpa%252FZL23316_8fdf552e71cf70a106e37fc9e7ef73e2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_8fdf552e71cf70a106e37fc9e7ef73e2.jpg already downloaded
2026-01-28 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f03e892-ef66-5d01-9568-eb3e8e72463c, identifier: ZL23316
2026-01-28 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-01-28 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9735fb9-49ac-51c2-89b9-dfd43c37c686 with scrape type 2
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9735fb9-49ac-51c2-89b9-dfd43c37c686 with scrape type 2
2026-01-28 17:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d9735fb9-49ac-51c2-89b9-dfd43c37c686, identifier: LV49535
2026-01-28 17:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb627b44-6738-5d94-a12f-2aa9054d0356 with identifier: PF38701
2026-01-28 17:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb627b44-6738-5d94-a12f-2aa9054d0356 with scrape type 2
2026-01-28 17:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb627b44-6738-5d94-a12f-2aa9054d0356 with scrape type 2
2026-01-28 17:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb627b44-6738-5d94-a12f-2aa9054d0356, identifier: PF38701
2026-01-28 17:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f03e892-ef66-5d01-9568-eb3e8e72463c with identifier: ZL23316
2026-01-28 17:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f03e892-ef66-5d01-9568-eb3e8e72463c with identifier: ZL23316
2026-01-28 17:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f03e892-ef66-5d01-9568-eb3e8e72463c with identifier: ZL23316 to the API
2026-01-28 17:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL23316>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:24:07Z',
 'fuel_type': 'diesel',
 'id': '0f03e892-ef66-5d01-9568-eb3e8e72463c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL23316',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'BMW',
 'model': '5er',
 'odometer': 107035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_866b47c51afc2f81a1b6832147196e26.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_74ccfbe6ca3ba431eee977c180658670.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_34523a8a1c4673e0e6af62c278676788.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_0c1d8f786078c44731514fee13ee8848.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_1f7f93d10431891fe1ffe51136b9cfd8.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f2c4546e6e25f0d66203b6ee8f844b1f.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_4c3c26f5c35d0516ae8779a5991ab823.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_755245b24ea0c5ba1282f60048e40def.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5874457ccb6b8e0acc24d4ba97dc8f1b.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f025c5cc47228110a76dd9dfc9893732.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_caf3b01ea20f10aca34136067245c503.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5681a66fa6bbc328c179cfa1541e481a.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_96e7507a21f19ddab60ee51fccb0c4be.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_d94da8a233894307586d88af5008cf4a.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_2bf18c035d1e23db387553d0cc743f67.jpg',
                'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_8fdf552e71cf70a106e37fc9e7ef73e2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_866b47c51afc2f81a1b6832147196e26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_74ccfbe6ca3ba431eee977c180658670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_34523a8a1c4673e0e6af62c278676788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_0c1d8f786078c44731514fee13ee8848.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_1f7f93d10431891fe1ffe51136b9cfd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f2c4546e6e25f0d66203b6ee8f844b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_4c3c26f5c35d0516ae8779a5991ab823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_755245b24ea0c5ba1282f60048e40def.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5874457ccb6b8e0acc24d4ba97dc8f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_f025c5cc47228110a76dd9dfc9893732.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_caf3b01ea20f10aca34136067245c503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_5681a66fa6bbc328c179cfa1541e481a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_96e7507a21f19ddab60ee51fccb0c4be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_d94da8a233894307586d88af5008cf4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_2bf18c035d1e23db387553d0cc743f67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f03e892-ef66-5d01-9568-eb3e8e72463c/0f03e892-ef66-5d01-9568-eb3e8e72463c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/42/db4214b6e7a84c5947f09ca5fa122e44/pa/ZL23316_8fdf552e71cf70a106e37fc9e7ef73e2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL23316%27 HTTP/1.1" 200 None
2026-01-28 17:06:23 [auto1.es] INFO: Saving data for ZL23316: {'created_time': 1769619983.122249, 'last_price_update_time': 1769619983.12226, 'auction_closing_time': 1769703847.0}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL23316') HTTP/1.1" 204 0
2026-01-28 17:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 with identifier: LV49535
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155624 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155624
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d9735fb9-49ac-51c2-89b9-dfd43c37c686 spider: auto1.es
2026-01-28 17:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d9735fb9-49ac-51c2-89b9-dfd43c37c686 due to rule: high_mileage_for_country.json, error: 155624 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155624
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:10:35Z',
 'fuel_type': 'diesel',
 'id': 'd9735fb9-49ac-51c2-89b9-dfd43c37c686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV49535',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 155624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV49535%27 HTTP/1.1" 200 None
2026-01-28 17:06:23 [auto1.es] INFO: Saving data for LV49535: {'auction_closing_time': 1769703035.0, 'created_time': 1768401140.304011, 'last_price_update_time': 1769619983.350614}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV49535') HTTP/1.1" 204 0
2026-01-28 17:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb627b44-6738-5d94-a12f-2aa9054d0356 with identifier: PF38701
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb627b44-6738-5d94-a12f-2aa9054d0356 with identifier: PF38701
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-28 17:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cb627b44-6738-5d94-a12f-2aa9054d0356 spider: auto1.es
2026-01-28 17:06:23 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cb627b44-6738-5d94-a12f-2aa9054d0356 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 80,
 'expiration_date': '2026-01-29T16:40:28Z',
 'fuel_type': 'diesel',
 'id': 'cb627b44-6738-5d94-a12f-2aa9054d0356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF38701',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 79071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-11',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
 'transmission': 'manual',
 'trim': 'Furgón Professional',
 'year': 2020}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PF38701%27 HTTP/1.1" 200 None
2026-01-28 17:06:23 [auto1.es] INFO: Saving data for PF38701: {'auction_closing_time': 1769704828.0, 'created_time': 1769101281.915143, 'last_price_update_time': 1769619983.569475}
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PF38701') HTTP/1.1" 204 0
2026-01-28 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9333c8992b206627855f5843341e64d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG68284> (referer: https://www.auto1.com/v1/car-details-view/NG68284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a0ae50>
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg saved to cache
2026-01-28 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ee2fed-2776-5aec-bfe8-944a3f500392 with identifier: UE26475
2026-01-28 17:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ee2fed-2776-5aec-bfe8-944a3f500392 with scrape type 2
2026-01-28 17:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ee2fed-2776-5aec-bfe8-944a3f500392 with scrape type 2
2026-01-28 17:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 96ee2fed-2776-5aec-bfe8-944a3f500392, identifier: UE26475
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63653410>
2026-01-28 17:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_a1b15e471f23909d02e63f6eb17748e5.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a1b15e471f23909d02e63f6eb17748e5.jpg saved to cache
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 96ee2fed-2776-5aec-bfe8-944a3f500392 with identifier: UE26475
2026-01-28 17:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 96ee2fed-2776-5aec-bfe8-944a3f500392 with identifier: UE26475
2026-01-28 17:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:06:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 96ee2fed-2776-5aec-bfe8-944a3f500392 spider: auto1.es
2026-01-28 17:06:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 96ee2fed-2776-5aec-bfe8-944a3f500392 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:04:39Z',
 'fuel_type': 'diesel',
 'id': '96ee2fed-2776-5aec-bfe8-944a3f500392',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE26475',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 99026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-12',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Allure L3',
 'transmission': 'automatic',
 'trim': 'Allure L3',
 'year': 2019}
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UE26475%27 HTTP/1.1" 200 None
2026-01-28 17:06:24 [auto1.es] INFO: Saving data for UE26475: {'auction_closing_time': 1769702679.0, 'created_time': 1768912869.658068, 'last_price_update_time': 1769619984.416307}
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UE26475') HTTP/1.1" 204 0
2026-01-28 17:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF95857> (referer: https://www.auto1.com/v1/car-details-view/DF95857/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b5f90>
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg saved to cache
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633e7c10>
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252F44%252F82442af03d011bd65900785be0161113%252Fpa%252FGH68553_9333c8992b206627855f5843341e64d9.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9333c8992b206627855f5843341e64d9.jpg saved to cache
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2
2026-01-28 17:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6915382b-163c-5dee-9ab3-1b5ef98edeb2, skipping ID generation
2026-01-28 17:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with scrape type 1
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6915382b-163c-5dee-9ab3-1b5ef98edeb2 from tracking dictionaries
2026-01-28 17:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6915382b-163c-5dee-9ab3-1b5ef98edeb2 sending to next pipeline
2026-01-28 17:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6915382b-163c-5dee-9ab3-1b5ef98edeb2, identifier: GH68553
2026-01-28 17:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07de098d-0308-51b7-8817-d6fb286ca896 with identifier: NG68284
2026-01-28 17:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07de098d-0308-51b7-8817-d6fb286ca896 with scrape type 1
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg not downloaded yet
2026-01-28 17:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with identifier: GH68553
2026-01-28 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with identifier: GH68553
2026-01-28 17:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6915382b-163c-5dee-9ab3-1b5ef98edeb2 with identifier: GH68553 to the API
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9333c8992b206627855f5843341e64d9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:15:23Z',
 'fuel_type': 'petrol',
 'id': '6915382b-163c-5dee-9ab3-1b5ef98edeb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH68553',
 'listing': 'auction',
 'location': 'ES, Lugo',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 129786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_75e7ae68415bbf2e4d0833766dedefeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9333c8992b206627855f5843341e64d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a1b15e471f23909d02e63f6eb17748e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_8ec732905116e475419e2e1553e4033d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_a2645b3d4235f4f4da2f9149d1786151.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_e8396526c38cb2c3de0ea61af87b72f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_50d831b9b2925fa69bdb5ce504d1b9d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_9c02dca13a701ec9540eef8d48c51d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23b5284536a7ef07f5b4853515176cf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d326c9588d3d1a9b563fbe4186c5455.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4782bf51c0098623b1df44f3c0dcec3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_23a7475c3d7309e57bcfdd68e7b245b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0f216a83d11abc72a011fa2c9d3506c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_4d16af7c99e4bff681bc0af8417a8e00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_099dc1f582e21c59b099a07f1dda1b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6915382b-163c-5dee-9ab3-1b5ef98edeb2/6915382b-163c-5dee-9ab3-1b5ef98edeb2_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/44/82442af03d011bd65900785be0161113/pa/GH68553_0ac12944cde5555951972aeb787b2a1b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line R&B',
 'transmission': 'manual',
 'trim': 'ST-Line R&B',
 'year': 2017}
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH68553%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [auto1.es] INFO: Saving data for GH68553: {'created_time': 1769619985.433925, 'last_price_update_time': 1769619985.433935, 'auction_closing_time': 1769703323.0}
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH68553') HTTP/1.1" 204 0
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_8895ecb4818f68fac4263224f424039b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_8895ecb4818f68fac4263224f424039b.jpg not downloaded yet
2026-01-28 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW12550> (referer: https://www.auto1.com/v1/car-details-view/FW12550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY28267> (referer: https://www.auto1.com/v1/car-details-view/VY28267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ80936> (referer: https://www.auto1.com/v1/car-details-view/NJ80936/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU92105> (referer: https://www.auto1.com/v1/car-details-view/FU92105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG65714> (referer: https://www.auto1.com/v1/car-details-view/SG65714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_17f24c48350824d48ac12648ee249776.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_17f24c48350824d48ac12648ee249776.jpg not downloaded yet
2026-01-28 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69f137ec-002a-5482-8631-612a115d2bc1 with identifier: DF95857
2026-01-28 17:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69f137ec-002a-5482-8631-612a115d2bc1 with scrape type 2
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69f137ec-002a-5482-8631-612a115d2bc1 with scrape type 2
2026-01-28 17:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 69f137ec-002a-5482-8631-612a115d2bc1, identifier: DF95857
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg not downloaded yet
2026-01-28 17:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 69f137ec-002a-5482-8631-612a115d2bc1 with identifier: DF95857
2026-01-28 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 69f137ec-002a-5482-8631-612a115d2bc1 with identifier: DF95857
2026-01-28 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 103719, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95857', 'expiration_date': '2026-01-29t16:51:13z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '69f137ec-002a-5482-8631-612a115d2bc1', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 103719}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:51:13z',
     'fuel_type': 'electro',
     'id': '69f137ec-002a-5482-8631-612a115d2bc1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95857',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 103719,
     'odometer_in_km': 103719,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 69f137ec-002a-5482-8631-612a115d2bc1 spider: auto1.es
2026-01-28 17:06:25 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 69f137ec-002a-5482-8631-612a115d2bc1 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 103719, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95857', 'expiration_date': '2026-01-29t16:51:13z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '69f137ec-002a-5482-8631-612a115d2bc1', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 103719}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:51:13z',
     'fuel_type': 'electro',
     'id': '69f137ec-002a-5482-8631-612a115d2bc1',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/df95857',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 103719,
     'odometer_in_km': 103719,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:51:13Z',
 'fuel_type': 'electro',
 'id': '69f137ec-002a-5482-8631-612a115d2bc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF95857',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 103719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DF95857%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [auto1.es] INFO: Saving data for DF95857: {'auction_closing_time': 1769705473.0, 'created_time': 1768324539.459422, 'last_price_update_time': 1769619985.810846}
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DF95857') HTTP/1.1" 204 0
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_b262eee0aa638f9673bea68409f56f87.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_b262eee0aa638f9673bea68409f56f87.jpg not downloaded yet
2026-01-28 17:06:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3764bb93-4da7-5c87-b658-1247162128cb with identifier: FW12550
2026-01-28 17:06:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3764bb93-4da7-5c87-b658-1247162128cb with scrape type 2
2026-01-28 17:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3764bb93-4da7-5c87-b658-1247162128cb with scrape type 2
2026-01-28 17:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3764bb93-4da7-5c87-b658-1247162128cb, identifier: FW12550
2026-01-28 17:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-01-28 17:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d268307-2399-5a10-bff1-00decfd055b5 with scrape type 1
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_b12cea4253095e4a6b6917f4d085e933.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_b12cea4253095e4a6b6917f4d085e933.jpg not downloaded yet
2026-01-28 17:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f7e676d-6944-572f-855a-1d4c8a0f05fa with identifier: NJ80936
2026-01-28 17:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f7e676d-6944-572f-855a-1d4c8a0f05fa with scrape type 2
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f7e676d-6944-572f-855a-1d4c8a0f05fa with scrape type 2
2026-01-28 17:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f7e676d-6944-572f-855a-1d4c8a0f05fa, identifier: NJ80936
2026-01-28 17:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ea8ea5-506b-5e24-a369-66adfd401042 with identifier: FU92105
2026-01-28 17:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea8ea5-506b-5e24-a369-66adfd401042 with scrape type 1
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_1965e9ca06cdab7cae5742473d2e192f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_1965e9ca06cdab7cae5742473d2e192f.jpg not downloaded yet
2026-01-28 17:06:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-01-28 17:06:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with scrape type 2
2026-01-28 17:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with scrape type 2
2026-01-28 17:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9, identifier: SG65714
2026-01-28 17:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3764bb93-4da7-5c87-b658-1247162128cb with identifier: FW12550
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3764bb93-4da7-5c87-b658-1247162128cb with identifier: FW12550
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 74343, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw12550', 'expiration_date': '2026-01-29t16:13:02z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '3764bb93-4da7-5c87-b658-1247162128cb', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 74343}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:13:02z',
     'fuel_type': 'electro',
     'id': '3764bb93-4da7-5c87-b658-1247162128cb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw12550',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 74343,
     'odometer_in_km': 74343,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 3764bb93-4da7-5c87-b658-1247162128cb spider: auto1.es
2026-01-28 17:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3764bb93-4da7-5c87-b658-1247162128cb due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 74343, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw12550', 'expiration_date': '2026-01-29t16:13:02z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '3764bb93-4da7-5c87-b658-1247162128cb', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 74343}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:13:02z',
     'fuel_type': 'electro',
     'id': '3764bb93-4da7-5c87-b658-1247162128cb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fw12550',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 74343,
     'odometer_in_km': 74343,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:13:02Z',
 'fuel_type': 'electro',
 'id': '3764bb93-4da7-5c87-b658-1247162128cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW12550',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 74343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FW12550%27 HTTP/1.1" 200 None
2026-01-28 17:06:26 [auto1.es] INFO: Saving data for FW12550: {'auction_closing_time': 1769703182.0, 'created_time': 1768324260.151575, 'last_price_update_time': 1769619986.503737}
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FW12550') HTTP/1.1" 204 0
2026-01-28 17:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f7e676d-6944-572f-855a-1d4c8a0f05fa with identifier: NJ80936
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f7e676d-6944-572f-855a-1d4c8a0f05fa with identifier: NJ80936
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162701 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162701
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0f7e676d-6944-572f-855a-1d4c8a0f05fa spider: auto1.es
2026-01-28 17:06:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0f7e676d-6944-572f-855a-1d4c8a0f05fa due to rule: high_mileage_for_country.json, error: 162701 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162701
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:03:13Z',
 'fuel_type': 'diesel',
 'id': '0f7e676d-6944-572f-855a-1d4c8a0f05fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ80936',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 162701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ80936%27 HTTP/1.1" 200 None
2026-01-28 17:06:26 [auto1.es] INFO: Saving data for NJ80936: {'auction_closing_time': 1769702593.0, 'created_time': 1769101534.690429, 'last_price_update_time': 1769619986.720329}
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ80936') HTTP/1.1" 204 0
2026-01-28 17:06:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-01-28 17:06:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714
2026-01-28 17:06:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 58de18c2-29a4-5f4a-9961-b57bc5e43cd9 with identifier: SG65714 to the API
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SG65714>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:55:41Z',
 'fuel_type': 'diesel',
 'id': '58de18c2-29a4-5f4a-9961-b57bc5e43cd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG65714',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 119252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2021}
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG65714%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [auto1.es] INFO: Saving data for SG65714: {'auction_closing_time': 1769705741.0, 'created_time': 1768401375.306351, 'last_price_update_time': 1769619987.022583}
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SG65714') HTTP/1.1" 204 0
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_8895ecb4818f68fac4263224f424039b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_3973f26e79ceedc224156754f5400d09.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3973f26e79ceedc224156754f5400d09.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_cba0eda10b459454a8e1215f02fc6477.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_cba0eda10b459454a8e1215f02fc6477.jpg not downloaded yet
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG49052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV02777> (referer: https://www.auto1.com/v1/car-details-view/CV02777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_44b436d877bb5231db2c69eb329e403a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_44b436d877bb5231db2c69eb329e403a.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_72223528fec1c7703f3ea20411f198fc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_72223528fec1c7703f3ea20411f198fc.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg not downloaded yet
2026-01-28 17:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_203cb186bb4c12a7a09a0c631a92f947.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_203cb186bb4c12a7a09a0c631a92f947.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg not downloaded yet
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_1965e9ca06cdab7cae5742473d2e192f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg not downloaded yet
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62866ad0>
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg saved to cache
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6296ffd0>
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_8895ecb4818f68fac4263224f424039b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_8895ecb4818f68fac4263224f424039b.jpg saved to cache
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_b12cea4253095e4a6b6917f4d085e933.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg not downloaded yet
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ca075508b2f97c72712ffeba272abd5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ca075508b2f97c72712ffeba272abd5b.jpg not downloaded yet
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3973f26e79ceedc224156754f5400d09.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_cba0eda10b459454a8e1215f02fc6477.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ12820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK39873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 with identifier: CV02777
2026-01-28 17:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 with scrape type 2
2026-01-28 17:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 with scrape type 2
2026-01-28 17:06:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7, identifier: CV02777
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62864e10>
2026-01-28 17:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_1965e9ca06cdab7cae5742473d2e192f.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_1965e9ca06cdab7cae5742473d2e192f.jpg saved to cache
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg not downloaded yet
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg not downloaded yet
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg not downloaded yet
2026-01-28 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 with identifier: CV02777
2026-01-28 17:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 with identifier: CV02777
2026-01-28 17:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-28 17:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 spider: auto1.es
2026-01-28 17:06:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:44:33Z',
 'fuel_type': 'diesel',
 'id': '4dd24b09-f1ca-5d3e-84fe-2f5f446d39b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV02777',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 103749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-01',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2020}
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV02777%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [auto1.es] INFO: Saving data for CV02777: {'auction_closing_time': 1769705073.0, 'created_time': 1768324729.649863, 'last_price_update_time': 1769619988.459964}
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CV02777') HTTP/1.1" 204 0
2026-01-28 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW92263/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_d57fdd82de08f5c88e10fb084263590e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_d57fdd82de08f5c88e10fb084263590e.jpg not downloaded yet
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg not downloaded yet
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_931515ff5b1a750a81d474617ec31c2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_931515ff5b1a750a81d474617ec31c2e.jpg not downloaded yet
2026-01-28 17:06:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ22818> (referer: https://www.auto1.com/v1/car-details-view/RJ22818/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6367c650>
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_b12cea4253095e4a6b6917f4d085e933.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_b12cea4253095e4a6b6917f4d085e933.jpg saved to cache
2026-01-28 17:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62842610>
2026-01-28 17:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_3973f26e79ceedc224156754f5400d09.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3973f26e79ceedc224156754f5400d09.jpg saved to cache
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62886790>
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_cba0eda10b459454a8e1215f02fc6477.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_cba0eda10b459454a8e1215f02fc6477.jpg saved to cache
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_6ed04220677689004756278ceab579e6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_6ed04220677689004756278ceab579e6.jpg not downloaded yet
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg not downloaded yet
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_2d2b85f8046f36694b9338aea2e6844d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_2d2b85f8046f36694b9338aea2e6844d.jpg not downloaded yet
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ca075508b2f97c72712ffeba272abd5b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260b0d0>
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg saved to cache
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d166406-bd41-59a9-9635-f3ad612f7b78 with identifier: RJ22818
2026-01-28 17:06:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d166406-bd41-59a9-9635-f3ad612f7b78 with scrape type 2
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d166406-bd41-59a9-9635-f3ad612f7b78 with scrape type 2
2026-01-28 17:06:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d166406-bd41-59a9-9635-f3ad612f7b78, identifier: RJ22818
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg not downloaded yet
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_9b172cb5438eb4489b9de7154b034c4d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_9b172cb5438eb4489b9de7154b034c4d.jpg not downloaded yet
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg not downloaded yet
2026-01-28 17:06:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d166406-bd41-59a9-9635-f3ad612f7b78 with identifier: RJ22818
2026-01-28 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d166406-bd41-59a9-9635-f3ad612f7b78 with identifier: RJ22818
2026-01-28 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2d166406-bd41-59a9-9635-f3ad612f7b78 spider: auto1.es
2026-01-28 17:06:29 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2d166406-bd41-59a9-9635-f3ad612f7b78 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:19:09Z',
 'fuel_type': 'diesel',
 'id': '2d166406-bd41-59a9-9635-f3ad612f7b78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ22818',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 116235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ22818%27 HTTP/1.1" 200 None
2026-01-28 17:06:29 [auto1.es] INFO: Saving data for RJ22818: {'auction_closing_time': 1769703549.0, 'created_time': 1768323793.478181, 'last_price_update_time': 1769619989.968323}
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RJ22818') HTTP/1.1" 204 0
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg not downloaded yet
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg not downloaded yet
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg not downloaded yet
2026-01-28 17:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP86334> (referer: https://www.auto1.com/v1/car-details-view/BP86334/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX30070> (referer: https://www.auto1.com/v1/car-details-view/XX30070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY55066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346ff90>
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg saved to cache
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6367e310>
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg saved to cache
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6367dc50>
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg saved to cache
2026-01-28 17:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626c7050>
2026-01-28 17:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg saved to cache
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627dd310>
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ca075508b2f97c72712ffeba272abd5b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ca075508b2f97c72712ffeba272abd5b.jpg saved to cache
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_f435cc7234165e8aa257e0348ae6afc4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_f435cc7234165e8aa257e0348ae6afc4.jpg not downloaded yet
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg not downloaded yet
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg not downloaded yet
2026-01-28 17:06:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_931515ff5b1a750a81d474617ec31c2e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg not downloaded yet
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_fb137bce17340253a59fa63c5365d904.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_fb137bce17340253a59fa63c5365d904.jpg not downloaded yet
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628134d0>
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg saved to cache
2026-01-28 17:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62691150>
2026-01-28 17:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg saved to cache
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62813090>
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg saved to cache
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ff02d6a-cc53-5133-959a-2f5259f37dd0 with identifier: BP86334
2026-01-28 17:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ff02d6a-cc53-5133-959a-2f5259f37dd0 with scrape type 2
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ff02d6a-cc53-5133-959a-2f5259f37dd0 with scrape type 2
2026-01-28 17:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1ff02d6a-cc53-5133-959a-2f5259f37dd0, identifier: BP86334
2026-01-28 17:06:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8aa71a79-a754-5df7-b562-b17494965d82 with identifier: XX30070
2026-01-28 17:06:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa71a79-a754-5df7-b562-b17494965d82 with scrape type 1
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg not downloaded yet
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1ff02d6a-cc53-5133-959a-2f5259f37dd0 with identifier: BP86334
2026-01-28 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1ff02d6a-cc53-5133-959a-2f5259f37dd0 with identifier: BP86334
2026-01-28 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137551 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137551
2026-01-28 17:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1ff02d6a-cc53-5133-959a-2f5259f37dd0 spider: auto1.es
2026-01-28 17:06:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1ff02d6a-cc53-5133-959a-2f5259f37dd0 due to rule: high_mileage_for_make.json, error: 137551 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    137551
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:33:51Z',
 'fuel_type': 'diesel',
 'id': '1ff02d6a-cc53-5133-959a-2f5259f37dd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP86334',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 137551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BP86334%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [auto1.es] INFO: Saving data for BP86334: {'auction_closing_time': 1769704431.0, 'created_time': 1768324491.388934, 'last_price_update_time': 1769619992.655538}
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BP86334') HTTP/1.1" 204 0
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_e18d751a51a268a523291a2dd44117de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_e18d751a51a268a523291a2dd44117de.jpg not downloaded yet
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_f77c402fdf156854225e6bf6a9e6e469.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f77c402fdf156854225e6bf6a9e6e469.jpg not downloaded yet
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_79a42298b0cc012193370c148659d3a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_79a42298b0cc012193370c148659d3a2.jpg not downloaded yet
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_2d2b85f8046f36694b9338aea2e6844d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR04580> (referer: https://www.auto1.com/v1/car-details-view/DR04580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF16630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_9b172cb5438eb4489b9de7154b034c4d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg not downloaded yet
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg not downloaded yet
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_ad16a751c6b4a2e66cc15340900da724.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ad16a751c6b4a2e66cc15340900da724.jpg not downloaded yet
2026-01-28 17:06:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272aa50>
2026-01-28 17:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg saved to cache
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a09f90>
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_931515ff5b1a750a81d474617ec31c2e.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_931515ff5b1a750a81d474617ec31c2e.jpg saved to cache
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63464990>
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg saved to cache
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_fb137bce17340253a59fa63c5365d904.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_86665a75890b8730a86355e46382dc48.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_86665a75890b8730a86355e46382dc48.jpg not downloaded yet
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg not downloaded yet
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg not downloaded yet
2026-01-28 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM36391/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BJ25544/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62665190>
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg saved to cache
2026-01-28 17:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628e5a50>
2026-01-28 17:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg saved to cache
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63443450>
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg saved to cache
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e41d0>
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_2d2b85f8046f36694b9338aea2e6844d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_2d2b85f8046f36694b9338aea2e6844d.jpg saved to cache
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e5590>
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg saved to cache
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6148a1a5-467f-512d-8d15-883a34c517fa with identifier: DR04580
2026-01-28 17:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6148a1a5-467f-512d-8d15-883a34c517fa with scrape type 1
2026-01-28 17:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6148a1a5-467f-512d-8d15-883a34c517fa
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_afe5430e53ad1f73b2d29f369b1dbc7b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_afe5430e53ad1f73b2d29f369b1dbc7b.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_b4df4c31fd226a2de6a3da988ea311b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_b4df4c31fd226a2de6a3da988ea311b0.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_75558ff5395bbb1bd87fb74cbf0a2136.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_75558ff5395bbb1bd87fb74cbf0a2136.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_bab859e3ffd2070e9f8df9883dc49fb3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_bab859e3ffd2070e9f8df9883dc49fb3.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_df8814b32871409005c64c890e6a160a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_df8814b32871409005c64c890e6a160a.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_0e01651d11331dc7a152ad27bad16be5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0e01651d11331dc7a152ad27bad16be5.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_642477a765b5d49f81743973bbc6af8e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_642477a765b5d49f81743973bbc6af8e.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_f98fc968f042abc24366cb21702e3276.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_f98fc968f042abc24366cb21702e3276.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_3db63d092691eeb2390e177d9b964d7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_3db63d092691eeb2390e177d9b964d7a.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_0f27670b0e7e5938ba3b8201e4bef70c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0f27670b0e7e5938ba3b8201e4bef70c.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_4098280f352268bc43529604c952c42f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4098280f352268bc43529604c952c42f.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_4f3ac28c34e599d65990102f722db87f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4f3ac28c34e599d65990102f722db87f.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_00da04ae8267427d26dcc556667ea272.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_00da04ae8267427d26dcc556667ea272.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_ccf7910076bb41cb13d6fbd2f963e88c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_ccf7910076bb41cb13d6fbd2f963e88c.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_5d0975f5eb8e01a5383f77c767a98acc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_5d0975f5eb8e01a5383f77c767a98acc.jpg already downloaded
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F64%252F06649ed33dd1e2f5f3a821ea797987b5%252Fpa%252FDR04580_efce367093e7c840b24400067ac35805.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_efce367093e7c840b24400067ac35805.jpg already downloaded
2026-01-28 17:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6148a1a5-467f-512d-8d15-883a34c517fa, identifier: DR04580
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628d5810>
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_9b172cb5438eb4489b9de7154b034c4d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_9b172cb5438eb4489b9de7154b034c4d.jpg saved to cache
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg not downloaded yet
2026-01-28 17:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6148a1a5-467f-512d-8d15-883a34c517fa with identifier: DR04580
2026-01-28 17:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6148a1a5-467f-512d-8d15-883a34c517fa with identifier: DR04580
2026-01-28 17:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6148a1a5-467f-512d-8d15-883a34c517fa with identifier: DR04580 to the API
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR04580>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:17:48Z',
 'fuel_type': 'petrol',
 'id': '6148a1a5-467f-512d-8d15-883a34c517fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR04580',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 82302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_afe5430e53ad1f73b2d29f369b1dbc7b.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_b4df4c31fd226a2de6a3da988ea311b0.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_75558ff5395bbb1bd87fb74cbf0a2136.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_bab859e3ffd2070e9f8df9883dc49fb3.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_df8814b32871409005c64c890e6a160a.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0e01651d11331dc7a152ad27bad16be5.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_642477a765b5d49f81743973bbc6af8e.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_f98fc968f042abc24366cb21702e3276.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_3db63d092691eeb2390e177d9b964d7a.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0f27670b0e7e5938ba3b8201e4bef70c.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4098280f352268bc43529604c952c42f.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4f3ac28c34e599d65990102f722db87f.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_00da04ae8267427d26dcc556667ea272.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_ccf7910076bb41cb13d6fbd2f963e88c.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_5d0975f5eb8e01a5383f77c767a98acc.jpg',
                'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_efce367093e7c840b24400067ac35805.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_afe5430e53ad1f73b2d29f369b1dbc7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_b4df4c31fd226a2de6a3da988ea311b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_75558ff5395bbb1bd87fb74cbf0a2136.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_bab859e3ffd2070e9f8df9883dc49fb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_df8814b32871409005c64c890e6a160a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0e01651d11331dc7a152ad27bad16be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_642477a765b5d49f81743973bbc6af8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_f98fc968f042abc24366cb21702e3276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96940,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_3db63d092691eeb2390e177d9b964d7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_0f27670b0e7e5938ba3b8201e4bef70c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4098280f352268bc43529604c952c42f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_4f3ac28c34e599d65990102f722db87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_00da04ae8267427d26dcc556667ea272.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_ccf7910076bb41cb13d6fbd2f963e88c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_5d0975f5eb8e01a5383f77c767a98acc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6148a1a5-467f-512d-8d15-883a34c517fa/6148a1a5-467f-512d-8d15-883a34c517fa_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/64/06649ed33dd1e2f5f3a821ea797987b5/pa/DR04580_efce367093e7c840b24400067ac35805.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 TGDI Launch Edition",
 'transmission': 'manual',
 'trim': 'Launch Edition',
 'year': 2018}
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DR04580%27 HTTP/1.1" 200 None
2026-01-28 17:06:36 [auto1.es] INFO: Saving data for DR04580: {'created_time': 1769619996.060159, 'last_price_update_time': 1769619996.060171, 'auction_closing_time': 1769703468.0}
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DR04580') HTTP/1.1" 204 0
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f77c402fdf156854225e6bf6a9e6e469.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_79a42298b0cc012193370c148659d3a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_e18d751a51a268a523291a2dd44117de.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_351569d8615eccec83d04f95d16f536b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_351569d8615eccec83d04f95d16f536b.jpg not downloaded yet
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK39873> (referer: https://www.auto1.com/v1/car-details-view/NK39873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW92263> (referer: https://www.auto1.com/v1/car-details-view/UW92263/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM05949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ12820> (referer: https://www.auto1.com/v1/car-details-view/XJ12820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627dfb50>
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_fb137bce17340253a59fa63c5365d904.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_fb137bce17340253a59fa63c5365d904.jpg saved to cache
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288fed0>
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg saved to cache
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627bd350>
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg saved to cache
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg not downloaded yet
2026-01-28 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ad16a751c6b4a2e66cc15340900da724.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY55066> (referer: https://www.auto1.com/v1/car-details-view/YY55066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6366a350>
2026-01-28 17:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg saved to cache
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626c4150>
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_f77c402fdf156854225e6bf6a9e6e469.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f77c402fdf156854225e6bf6a9e6e469.jpg saved to cache
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62651b50>
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg saved to cache
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e5d90>
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_79a42298b0cc012193370c148659d3a2.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_79a42298b0cc012193370c148659d3a2.jpg saved to cache
2026-01-28 17:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8c9d0>
2026-01-28 17:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_e18d751a51a268a523291a2dd44117de.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_e18d751a51a268a523291a2dd44117de.jpg saved to cache
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4123f849-61ac-52af-bfa5-3ece2300c8e2 with identifier: NK39873
2026-01-28 17:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4123f849-61ac-52af-bfa5-3ece2300c8e2 with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4123f849-61ac-52af-bfa5-3ece2300c8e2 with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4123f849-61ac-52af-bfa5-3ece2300c8e2, identifier: NK39873
2026-01-28 17:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669efa3d-0fc9-504a-b4f6-87d5b631808c with identifier: UW92263
2026-01-28 17:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669efa3d-0fc9-504a-b4f6-87d5b631808c with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 669efa3d-0fc9-504a-b4f6-87d5b631808c with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 669efa3d-0fc9-504a-b4f6-87d5b631808c, identifier: UW92263
2026-01-28 17:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with identifier: XJ12820
2026-01-28 17:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with scrape type 2
2026-01-28 17:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4f76304c-118d-5f8c-ac69-a47c6ec3fcec, identifier: XJ12820
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_9a3cda6714fbfff99eda654dc830a21a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_9a3cda6714fbfff99eda654dc830a21a.jpg not downloaded yet
2026-01-28 17:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4123f849-61ac-52af-bfa5-3ece2300c8e2 with identifier: NK39873
2026-01-28 17:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4123f849-61ac-52af-bfa5-3ece2300c8e2 with identifier: NK39873
2026-01-28 17:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4123f849-61ac-52af-bfa5-3ece2300c8e2 with identifier: NK39873 to the API
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NK39873>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2026-01-29T16:21:42Z',
 'fuel_type': 'electro',
 'id': '4123f849-61ac-52af-bfa5-3ece2300c8e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK39873',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 86173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-26',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NK39873%27 HTTP/1.1" 200 None
2026-01-28 17:06:38 [auto1.es] INFO: Saving data for NK39873: {'auction_closing_time': 1769703702.0, 'created_time': 1768323701.067519, 'last_price_update_time': 1769619998.850651}
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NK39873') HTTP/1.1" 204 0
2026-01-28 17:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 669efa3d-0fc9-504a-b4f6-87d5b631808c with identifier: UW92263
2026-01-28 17:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 669efa3d-0fc9-504a-b4f6-87d5b631808c with identifier: UW92263
2026-01-28 17:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 669efa3d-0fc9-504a-b4f6-87d5b631808c with identifier: UW92263 to the API
2026-01-28 17:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UW92263>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:13:23Z',
 'fuel_type': 'diesel',
 'id': '669efa3d-0fc9-504a-b4f6-87d5b631808c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW92263',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 8904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Black Line',
 'transmission': 'automatic',
 'trim': 'Black Line',
 'year': 2023}
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UW92263%27 HTTP/1.1" 200 None
2026-01-28 17:06:39 [auto1.es] INFO: Saving data for UW92263: {'auction_closing_time': 1769703203.0, 'created_time': 1768825747.873524, 'last_price_update_time': 1769619999.179464}
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UW92263') HTTP/1.1" 204 0
2026-01-28 17:06:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with identifier: XJ12820
2026-01-28 17:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with identifier: XJ12820
2026-01-28 17:06:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4f76304c-118d-5f8c-ac69-a47c6ec3fcec with identifier: XJ12820 to the API
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ12820>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2026-01-29T16:17:28Z',
 'fuel_type': 'electro',
 'id': '4f76304c-118d-5f8c-ac69-a47c6ec3fcec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ12820',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 71247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ12820%27 HTTP/1.1" 200 None
2026-01-28 17:06:39 [auto1.es] INFO: Saving data for XJ12820: {'auction_closing_time': 1769703448.0, 'created_time': 1768323732.978012, 'last_price_update_time': 1769619999.483464}
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ12820') HTTP/1.1" 204 0
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_86665a75890b8730a86355e46382dc48.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_f435cc7234165e8aa257e0348ae6afc4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg not downloaded yet
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_203cb186bb4c12a7a09a0c631a92f947.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_6ed04220677689004756278ceab579e6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg not downloaded yet
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aae1d0>
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg saved to cache
2026-01-28 17:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c5950>
2026-01-28 17:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg saved to cache
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63501b10>
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg saved to cache
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627435d0>
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_ad16a751c6b4a2e66cc15340900da724.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ad16a751c6b4a2e66cc15340900da724.jpg saved to cache
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289fe50>
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg saved to cache
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2805bd97-5fb7-5000-a36b-7d2937ecff80 with identifier: YY55066
2026-01-28 17:06:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2805bd97-5fb7-5000-a36b-7d2937ecff80 with scrape type 2
2026-01-28 17:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2805bd97-5fb7-5000-a36b-7d2937ecff80 with scrape type 2
2026-01-28 17:06:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2805bd97-5fb7-5000-a36b-7d2937ecff80, identifier: YY55066
2026-01-28 17:06:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2805bd97-5fb7-5000-a36b-7d2937ecff80 with identifier: YY55066
2026-01-28 17:06:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2805bd97-5fb7-5000-a36b-7d2937ecff80 with identifier: YY55066
2026-01-28 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
2026-01-28 17:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2805bd97-5fb7-5000-a36b-7d2937ecff80 spider: auto1.es
2026-01-28 17:06:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2805bd97-5fb7-5000-a36b-7d2937ecff80 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo' containing 'kangoo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 80,
 'expiration_date': '2026-01-29T16:30:59Z',
 'fuel_type': 'diesel',
 'id': '2805bd97-5fb7-5000-a36b-7d2937ecff80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY55066',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 157757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Furgón Professional',
 'transmission': 'manual',
 'trim': 'Furgón Professional',
 'year': 2022}
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY55066%27 HTTP/1.1" 200 None
2026-01-28 17:06:41 [auto1.es] INFO: Saving data for YY55066: {'auction_closing_time': 1769704259.0, 'created_time': 1768401971.628333, 'last_price_update_time': 1769620001.16929}
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YY55066') HTTP/1.1" 204 0
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_f35e238f55e7ff7655eb9055601325ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f35e238f55e7ff7655eb9055601325ef.jpg not downloaded yet
2026-01-28 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_351569d8615eccec83d04f95d16f536b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF16630> (referer: https://www.auto1.com/v1/car-details-view/LF16630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6270a3d0>
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg saved to cache
2026-01-28 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340c5d0>
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_86665a75890b8730a86355e46382dc48.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_86665a75890b8730a86355e46382dc48.jpg saved to cache
2026-01-28 17:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635b9690>
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_f435cc7234165e8aa257e0348ae6afc4.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_f435cc7234165e8aa257e0348ae6afc4.jpg saved to cache
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627ce490>
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_203cb186bb4c12a7a09a0c631a92f947.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_203cb186bb4c12a7a09a0c631a92f947.jpg saved to cache
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340cd50>
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg saved to cache
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6331ea90>
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg saved to cache
2026-01-28 17:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635ba150>
2026-01-28 17:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_6ed04220677689004756278ceab579e6.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_6ed04220677689004756278ceab579e6.jpg saved to cache
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_72223528fec1c7703f3ea20411f198fc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_9a3cda6714fbfff99eda654dc830a21a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_f3001bc0092e258d10585a575d514841.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f3001bc0092e258d10585a575d514841.jpg not downloaded yet
2026-01-28 17:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg not downloaded yet
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG49052> (referer: https://www.auto1.com/v1/car-details-view/JG49052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BJ25544> (referer: https://www.auto1.com/v1/car-details-view/BJ25544/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM36391> (referer: https://www.auto1.com/v1/car-details-view/EM36391/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg not downloaded yet
2026-01-28 17:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63485510>
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg saved to cache
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a4590>
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F05%252Fdc058d8c5e41afb22d2fdce4fc06d9c6%252Fpa%252FFU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg saved to cache
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 00ea8ea5-506b-5e24-a369-66adfd401042
2026-01-28 17:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 00ea8ea5-506b-5e24-a369-66adfd401042, skipping ID generation
2026-01-28 17:06:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ea8ea5-506b-5e24-a369-66adfd401042 with scrape type 1
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 00ea8ea5-506b-5e24-a369-66adfd401042 from tracking dictionaries
2026-01-28 17:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 00ea8ea5-506b-5e24-a369-66adfd401042 sending to next pipeline
2026-01-28 17:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 00ea8ea5-506b-5e24-a369-66adfd401042, identifier: FU92105
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62809790>
2026-01-28 17:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_351569d8615eccec83d04f95d16f536b.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_351569d8615eccec83d04f95d16f536b.jpg saved to cache
2026-01-28 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d3562db-d296-5a89-af45-1afb8501b2f8 with identifier: LF16630
2026-01-28 17:06:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d3562db-d296-5a89-af45-1afb8501b2f8 with scrape type 2
2026-01-28 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d3562db-d296-5a89-af45-1afb8501b2f8 with scrape type 2
2026-01-28 17:06:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0d3562db-d296-5a89-af45-1afb8501b2f8, identifier: LF16630
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_44b436d877bb5231db2c69eb329e403a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 00ea8ea5-506b-5e24-a369-66adfd401042 with identifier: FU92105
2026-01-28 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 00ea8ea5-506b-5e24-a369-66adfd401042 with identifier: FU92105
2026-01-28 17:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 00ea8ea5-506b-5e24-a369-66adfd401042 with identifier: FU92105 to the API
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:30:57Z',
 'fuel_type': 'diesel',
 'id': '00ea8ea5-506b-5e24-a369-66adfd401042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU92105',
 'listing': 'auction',
 'location': 'Leganés',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 46354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_1965e9ca06cdab7cae5742473d2e192f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_cba0eda10b459454a8e1215f02fc6477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_3b72ac1ccef49ba894df6bbd6f8da422.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_4561c37e6d895aeb8f2cc8caa434d4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_8ed8fdd85d2a323b98ee739afcf4c7a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ca075508b2f97c72712ffeba272abd5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5849137b9b84e90b19aca63f0ebb28ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_931515ff5b1a750a81d474617ec31c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_2d2b85f8046f36694b9338aea2e6844d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_5b49615ed5726aa5664ec0f9f0da03db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ad6a84b9aebb91e74a212e5f5b387647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f5a6ebf9ba1e500bdc30d206c5abd821.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_fb137bce17340253a59fa63c5365d904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_f77c402fdf156854225e6bf6a9e6e469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_e6e7b134c469794b1ea31a17bfec2e21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00ea8ea5-506b-5e24-a369-66adfd401042/00ea8ea5-506b-5e24-a369-66adfd401042_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/05/dc058d8c5e41afb22d2fdce4fc06d9c6/pa/FU92105_ceaecdbdaa6a094244e76ae2ca7390d5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 1.5 Blue-HDi Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2022}
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU92105%27 HTTP/1.1" 200 None
2026-01-28 17:06:44 [auto1.es] INFO: Saving data for FU92105: {'created_time': 1769620004.541525, 'last_price_update_time': 1769620004.54154, 'auction_closing_time': 1769704257.0}
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FU92105') HTTP/1.1" 204 0
2026-01-28 17:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0d3562db-d296-5a89-af45-1afb8501b2f8 with identifier: LF16630
2026-01-28 17:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0d3562db-d296-5a89-af45-1afb8501b2f8 with identifier: LF16630
2026-01-28 17:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0d3562db-d296-5a89-af45-1afb8501b2f8 with identifier: LF16630 to the API
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LF16630>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2026-01-29T16:36:31Z',
 'fuel_type': 'electro',
 'id': '0d3562db-d296-5a89-af45-1afb8501b2f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF16630',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 81335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-26',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LF16630%27 HTTP/1.1" 200 None
2026-01-28 17:06:44 [auto1.es] INFO: Saving data for LF16630: {'auction_closing_time': 1769704591.0, 'created_time': 1768323746.063929, 'last_price_update_time': 1769620004.89079}
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LF16630') HTTP/1.1" 204 0
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_b262eee0aa638f9673bea68409f56f87.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg not downloaded yet
2026-01-28 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f35e238f55e7ff7655eb9055601325ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_17f24c48350824d48ac12648ee249776.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM05949> (referer: https://www.auto1.com/v1/car-details-view/PM05949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_963d23309c0c8d322ed1f4389973c677.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_963d23309c0c8d322ed1f4389973c677.jpg not downloaded yet
2026-01-28 17:06:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62875dd0>
2026-01-28 17:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F03%252F2503d689770631a3a92cc649b719baa5%252Fpa%252FVY28267_72223528fec1c7703f3ea20411f198fc.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_72223528fec1c7703f3ea20411f198fc.jpg saved to cache
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d268307-2399-5a10-bff1-00decfd055b5
2026-01-28 17:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d268307-2399-5a10-bff1-00decfd055b5, skipping ID generation
2026-01-28 17:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d268307-2399-5a10-bff1-00decfd055b5 with scrape type 1
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4d268307-2399-5a10-bff1-00decfd055b5 from tracking dictionaries
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d268307-2399-5a10-bff1-00decfd055b5 sending to next pipeline
2026-01-28 17:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d268307-2399-5a10-bff1-00decfd055b5, identifier: VY28267
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a16750>
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg saved to cache
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d2cd0>
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_9a3cda6714fbfff99eda654dc830a21a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_9a3cda6714fbfff99eda654dc830a21a.jpg saved to cache
2026-01-28 17:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62875bd0>
2026-01-28 17:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg saved to cache
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49557dbd-d6a7-5491-93a5-3be06a150971 with identifier: JG49052
2026-01-28 17:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49557dbd-d6a7-5491-93a5-3be06a150971 with scrape type 2
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49557dbd-d6a7-5491-93a5-3be06a150971 with scrape type 2
2026-01-28 17:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49557dbd-d6a7-5491-93a5-3be06a150971, identifier: JG49052
2026-01-28 17:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d with identifier: BJ25544
2026-01-28 17:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d with scrape type 2
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d with scrape type 2
2026-01-28 17:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d, identifier: BJ25544
2026-01-28 17:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 621644d7-dad0-50d9-b854-f67353e4bc69 with identifier: EM36391
2026-01-28 17:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 621644d7-dad0-50d9-b854-f67353e4bc69 with scrape type 1
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 621644d7-dad0-50d9-b854-f67353e4bc69
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_126d4ddbaa953b48f05166ecff8e0139.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_126d4ddbaa953b48f05166ecff8e0139.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_2723517145ffc6e8fce3a4cfb4213de3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_2723517145ffc6e8fce3a4cfb4213de3.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_18235f7d8a0e96052d2bfbc52b87b604.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_18235f7d8a0e96052d2bfbc52b87b604.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_925fef3d818db53e8bb1c4df2861b80e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_925fef3d818db53e8bb1c4df2861b80e.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_1ebb1e011c9d27ad2dde64599a310a65.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_1ebb1e011c9d27ad2dde64599a310a65.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_7538c41b928ff642570e7298a05bbe71.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_7538c41b928ff642570e7298a05bbe71.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_0674fefefe8ecb1f286d9c6ebe047adb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_0674fefefe8ecb1f286d9c6ebe047adb.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_013c3d31267dbfeadbe7833763ff54fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_013c3d31267dbfeadbe7833763ff54fa.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_d5696ddc9d89cec297e612a823a7c58b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d5696ddc9d89cec297e612a823a7c58b.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_98659c39717d54c3251e57405bfaed46.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_98659c39717d54c3251e57405bfaed46.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_5d3a63156981584a0d140ed5ba672fb5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d3a63156981584a0d140ed5ba672fb5.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_6b1c2ad97352e5a9332a8d6e9b064c4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_6b1c2ad97352e5a9332a8d6e9b064c4a.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_5d40efec96b38301154452cb140c0ce3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d40efec96b38301154452cb140c0ce3.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_4d1a47c149ae50a0c6dfd8207a4caabc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_4d1a47c149ae50a0c6dfd8207a4caabc.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_d6520d61c719186b189c11637bfc5256.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d6520d61c719186b189c11637bfc5256.jpg already downloaded
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252F57%252Fed573fd1c2825352ae0359fdc66b80f7%252Fpa%252FEM36391_31bc70d7d6a53f9fb64218b02003af99.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_31bc70d7d6a53f9fb64218b02003af99.jpg already downloaded
2026-01-28 17:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 621644d7-dad0-50d9-b854-f67353e4bc69, identifier: EM36391
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a68b50>
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_44b436d877bb5231db2c69eb329e403a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_44b436d877bb5231db2c69eb329e403a.jpg saved to cache
2026-01-28 17:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_d57fdd82de08f5c88e10fb084263590e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-01-28 17:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d268307-2399-5a10-bff1-00decfd055b5 with identifier: VY28267
2026-01-28 17:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151664 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151664
2026-01-28 17:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4d268307-2399-5a10-bff1-00decfd055b5 spider: auto1.es
2026-01-28 17:06:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4d268307-2399-5a10-bff1-00decfd055b5 due to rule: high_mileage_for_country.json, error: 151664 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151664
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:42:13Z',
 'fuel_type': 'diesel',
 'id': '4d268307-2399-5a10-bff1-00decfd055b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY28267',
 'listing': 'auction',
 'location': 'ES, Castelló de la Plana',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 151664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_b12cea4253095e4a6b6917f4d085e933.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3973f26e79ceedc224156754f5400d09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_72223528fec1c7703f3ea20411f198fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_203cb186bb4c12a7a09a0c631a92f947.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5951aa21bd40502d0dbef02a27c1dfc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_74723d035ff1761ac8f83ada0b4d10c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_7c7af8f4d654aa81abe6671b62f465ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_f095fd2bbf106b3379a3a1437dd5a10a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_fa61a45c5bfa2b9c45e43a31c37e6223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_9b172cb5438eb4489b9de7154b034c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_5dd2051fd46be2bd7a5192614a9087d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_cb6c94cf1a2313f4da98b74f12b3de0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_416ac84ca20d78df03a7eb3b88573f7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_e18d751a51a268a523291a2dd44117de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_3f2e1900f4252159d61f65414f7e5aa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d268307-2399-5a10-bff1-00decfd055b5/4d268307-2399-5a10-bff1-00decfd055b5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/03/2503d689770631a3a92cc649b719baa5/pa/VY28267_86665a75890b8730a86355e46382dc48.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2018}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VY28267%27 HTTP/1.1" 200 None
2026-01-28 17:06:47 [auto1.es] INFO: Saving data for VY28267: {'created_time': 1769620007.093346, 'last_price_update_time': 1769620007.093358, 'auction_closing_time': 1769704933.0}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VY28267') HTTP/1.1" 204 0
2026-01-28 17:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49557dbd-d6a7-5491-93a5-3be06a150971 with identifier: JG49052
2026-01-28 17:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49557dbd-d6a7-5491-93a5-3be06a150971 with identifier: JG49052
2026-01-28 17:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49557dbd-d6a7-5491-93a5-3be06a150971 with identifier: JG49052 to the API
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JG49052>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:01:40Z',
 'fuel_type': 'diesel',
 'id': '49557dbd-d6a7-5491-93a5-3be06a150971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG49052',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 139046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2022}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JG49052%27 HTTP/1.1" 200 None
2026-01-28 17:06:47 [auto1.es] INFO: Saving data for JG49052: {'auction_closing_time': 1769702500.0, 'created_time': 1768323743.109627, 'last_price_update_time': 1769620007.426784}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JG49052') HTTP/1.1" 204 0
2026-01-28 17:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d with identifier: BJ25544
2026-01-28 17:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d with identifier: BJ25544
2026-01-28 17:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d spider: auto1.es
2026-01-28 17:06:47 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:15:29Z',
 'fuel_type': 'diesel',
 'id': 'eb0ffc7b-e6b7-54fd-84e8-d8e743b1ba4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ25544',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 91276,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ25544%27 HTTP/1.1" 200 None
2026-01-28 17:06:47 [auto1.es] INFO: Saving data for BJ25544: {'auction_closing_time': 1769703329.0, 'created_time': 1768401565.673279, 'last_price_update_time': 1769620007.670284}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BJ25544') HTTP/1.1" 204 0
2026-01-28 17:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 621644d7-dad0-50d9-b854-f67353e4bc69 with identifier: EM36391
2026-01-28 17:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 621644d7-dad0-50d9-b854-f67353e4bc69 with identifier: EM36391
2026-01-28 17:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 621644d7-dad0-50d9-b854-f67353e4bc69 with identifier: EM36391 to the API
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM36391>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:50:38Z',
 'fuel_type': 'petrol',
 'id': '621644d7-dad0-50d9-b854-f67353e4bc69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM36391',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 51397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_126d4ddbaa953b48f05166ecff8e0139.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_2723517145ffc6e8fce3a4cfb4213de3.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_18235f7d8a0e96052d2bfbc52b87b604.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_925fef3d818db53e8bb1c4df2861b80e.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_1ebb1e011c9d27ad2dde64599a310a65.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_7538c41b928ff642570e7298a05bbe71.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_0674fefefe8ecb1f286d9c6ebe047adb.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_013c3d31267dbfeadbe7833763ff54fa.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d5696ddc9d89cec297e612a823a7c58b.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_98659c39717d54c3251e57405bfaed46.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d3a63156981584a0d140ed5ba672fb5.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_6b1c2ad97352e5a9332a8d6e9b064c4a.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d40efec96b38301154452cb140c0ce3.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_4d1a47c149ae50a0c6dfd8207a4caabc.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d6520d61c719186b189c11637bfc5256.jpg',
                'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_31bc70d7d6a53f9fb64218b02003af99.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_126d4ddbaa953b48f05166ecff8e0139.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_2723517145ffc6e8fce3a4cfb4213de3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_18235f7d8a0e96052d2bfbc52b87b604.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_925fef3d818db53e8bb1c4df2861b80e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_1ebb1e011c9d27ad2dde64599a310a65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_7538c41b928ff642570e7298a05bbe71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_0674fefefe8ecb1f286d9c6ebe047adb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_013c3d31267dbfeadbe7833763ff54fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d5696ddc9d89cec297e612a823a7c58b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_98659c39717d54c3251e57405bfaed46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d3a63156981584a0d140ed5ba672fb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_6b1c2ad97352e5a9332a8d6e9b064c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_5d40efec96b38301154452cb140c0ce3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_4d1a47c149ae50a0c6dfd8207a4caabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_d6520d61c719186b189c11637bfc5256.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_621644d7-dad0-50d9-b854-f67353e4bc69/621644d7-dad0-50d9-b854-f67353e4bc69_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/57/ed573fd1c2825352ae0359fdc66b80f7/pa/EM36391_31bc70d7d6a53f9fb64218b02003af99.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 e-THP GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2019}
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM36391%27 HTTP/1.1" 200 None
2026-01-28 17:06:47 [auto1.es] INFO: Saving data for EM36391: {'created_time': 1769620007.995448, 'last_price_update_time': 1769620007.995458, 'auction_closing_time': 1769705438.0}
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM36391') HTTP/1.1" 204 0
2026-01-28 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f3001bc0092e258d10585a575d514841.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269d1d0>
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_b262eee0aa638f9673bea68409f56f87.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_b262eee0aa638f9673bea68409f56f87.jpg saved to cache
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635d6250>
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg saved to cache
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290f990>
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg saved to cache
2026-01-28 17:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6364fed0>
2026-01-28 17:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_f35e238f55e7ff7655eb9055601325ef.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f35e238f55e7ff7655eb9055601325ef.jpg saved to cache
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269dd50>
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg saved to cache
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a60a50>
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_17f24c48350824d48ac12648ee249776.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_17f24c48350824d48ac12648ee249776.jpg saved to cache
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3776172e-7114-51f4-bfa1-23eb04c338cb with identifier: PM05949
2026-01-28 17:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3776172e-7114-51f4-bfa1-23eb04c338cb with scrape type 1
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg not downloaded yet
2026-01-28 17:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f5d10>
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F6f%252F9d6f97122abe4c3bb199b211fbccd1cf%252Fpa%252FNG68284_d57fdd82de08f5c88e10fb084263590e.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_d57fdd82de08f5c88e10fb084263590e.jpg saved to cache
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 07de098d-0308-51b7-8817-d6fb286ca896
2026-01-28 17:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07de098d-0308-51b7-8817-d6fb286ca896, skipping ID generation
2026-01-28 17:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07de098d-0308-51b7-8817-d6fb286ca896 with scrape type 1
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07de098d-0308-51b7-8817-d6fb286ca896 from tracking dictionaries
2026-01-28 17:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07de098d-0308-51b7-8817-d6fb286ca896 sending to next pipeline
2026-01-28 17:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 07de098d-0308-51b7-8817-d6fb286ca896, identifier: NG68284
2026-01-28 17:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 07de098d-0308-51b7-8817-d6fb286ca896 with identifier: NG68284
2026-01-28 17:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 07de098d-0308-51b7-8817-d6fb286ca896 with identifier: NG68284
2026-01-28 17:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 07de098d-0308-51b7-8817-d6fb286ca896 with identifier: NG68284 to the API
2026-01-28 17:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_d57fdd82de08f5c88e10fb084263590e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:28:38Z',
 'fuel_type': 'petrol',
 'id': '07de098d-0308-51b7-8817-d6fb286ca896',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG68284',
 'listing': 'auction',
 'location': 'ES, Huelva',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 41108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4290e127aeb8cd4ae05991d7aec4710a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_8895ecb4818f68fac4263224f424039b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_17f24c48350824d48ac12648ee249776.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2c6a45dd9d0f82e3827714c4a93315be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_b262eee0aa638f9673bea68409f56f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_ccb4cca9cb7902470e4d1f4c5286afd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_44b436d877bb5231db2c69eb329e403a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_9604fe884d8dacbcf541e862ab8d47ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4e53134b61f7ef72ab4f78a18984cd2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_2d18048f8ad078e76b9b5ca36a715efe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_e20126f371e78d4cb0f42d9e87e03d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2336081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_d57fdd82de08f5c88e10fb084263590e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_6ed04220677689004756278ceab579e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_33052a62aa2fed7d1d25d2eda337b98e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_4f99c8b66dd506757b41ea6ea6bb7067.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07de098d-0308-51b7-8817-d6fb286ca896/07de098d-0308-51b7-8817-d6fb286ca896_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/6f/9d6f97122abe4c3bb199b211fbccd1cf/pa/NG68284_f435cc7234165e8aa257e0348ae6afc4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2022}
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NG68284%27 HTTP/1.1" 200 None
2026-01-28 17:06:50 [auto1.es] INFO: Saving data for NG68284: {'created_time': 1769620010.211879, 'last_price_update_time': 1769620010.21189, 'auction_closing_time': 1769704118.0}
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NG68284') HTTP/1.1" 204 0
2026-01-28 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg not downloaded yet
2026-01-28 17:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_963d23309c0c8d322ed1f4389973c677.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341b110>
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg saved to cache
2026-01-28 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62767a90>
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg saved to cache
2026-01-28 17:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633e4150>
2026-01-28 17:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_f3001bc0092e258d10585a575d514841.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f3001bc0092e258d10585a575d514841.jpg saved to cache
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_7cbf4f38828f950943a949777f7e3f53.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_7cbf4f38828f950943a949777f7e3f53.jpg not downloaded yet
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6274d7d0>
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg saved to cache
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_131c9e921113d3572fdf9e7c7c41e462.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_131c9e921113d3572fdf9e7c7c41e462.jpg not downloaded yet
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG47360/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES71319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB23846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GU10653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PD89077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX61881/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_a9d9c09a1985be337bfee0f456d5d177.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a9d9c09a1985be337bfee0f456d5d177.jpg not downloaded yet
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62767790>
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252F00%252F1000fd5f9b791fc317d8c811da110d3b%252Fpa%252FXX30070_963d23309c0c8d322ed1f4389973c677.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_963d23309c0c8d322ed1f4389973c677.jpg saved to cache
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8aa71a79-a754-5df7-b562-b17494965d82
2026-01-28 17:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8aa71a79-a754-5df7-b562-b17494965d82, skipping ID generation
2026-01-28 17:06:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8aa71a79-a754-5df7-b562-b17494965d82 with scrape type 1
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8aa71a79-a754-5df7-b562-b17494965d82 from tracking dictionaries
2026-01-28 17:06:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8aa71a79-a754-5df7-b562-b17494965d82 sending to next pipeline
2026-01-28 17:06:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8aa71a79-a754-5df7-b562-b17494965d82, identifier: XX30070
2026-01-28 17:06:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8aa71a79-a754-5df7-b562-b17494965d82 with identifier: XX30070
2026-01-28 17:06:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8aa71a79-a754-5df7-b562-b17494965d82 with identifier: XX30070
2026-01-28 17:06:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8aa71a79-a754-5df7-b562-b17494965d82 with identifier: XX30070 to the API
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_963d23309c0c8d322ed1f4389973c677.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 106,
 'expiration_date': '2026-01-29T16:01:41Z',
 'fuel_type': 'petrol',
 'id': '8aa71a79-a754-5df7-b562-b17494965d82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX30070',
 'listing': 'auction',
 'location': 'ES, Lugones',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 6692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_173aaa57eb0b0101ee998a6f19fe2ade.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_79a42298b0cc012193370c148659d3a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ad16a751c6b4a2e66cc15340900da724.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_597374065aa62bad4ea1b06e22d9c2c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_227282db1cad6e1d0ddf3bfa478089fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_351569d8615eccec83d04f95d16f536b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_2c40a1e5433aca1f7052a221580e2cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_9a3cda6714fbfff99eda654dc830a21a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_bfd7cc23cdb479b687fb947891a38b7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_83145eabc5c1be700043c55b6d2d5c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f35e238f55e7ff7655eb9055601325ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_f3001bc0092e258d10585a575d514841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_cd0e6bcee9f1cd3915f08e695c787347.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_ef65b15d0dd2d9321e093aa8e1c9cd32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61670,
             'Height': 597,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_11dc11b69daf9a6c0190d21f3ffe6ff2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8aa71a79-a754-5df7-b562-b17494965d82/8aa71a79-a754-5df7-b562-b17494965d82_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/00/1000fd5f9b791fc317d8c811da110d3b/pa/XX30070_963d23309c0c8d322ed1f4389973c677.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XX30070%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [auto1.es] INFO: Saving data for XX30070: {'created_time': 1769620012.102778, 'last_price_update_time': 1769620012.102791, 'auction_closing_time': 1769702501.0}
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XX30070') HTTP/1.1" 204 0
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg not downloaded yet
2026-01-28 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CL61096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365ef10>
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg saved to cache
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_36762b1064d9225bc858919c792673d1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_36762b1064d9225bc858919c792673d1.jpg not downloaded yet
2026-01-28 17:06:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_131c9e921113d3572fdf9e7c7c41e462.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg not downloaded yet
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg not downloaded yet
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg not downloaded yet
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_4f706cb43d776c92c9c469ba97945c6d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_4f706cb43d776c92c9c469ba97945c6d.jpg not downloaded yet
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg not downloaded yet
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_952b171311536a15123c379cdfa51d38.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_952b171311536a15123c379cdfa51d38.jpg not downloaded yet
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629fb150>
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_131c9e921113d3572fdf9e7c7c41e462.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_131c9e921113d3572fdf9e7c7c41e462.jpg saved to cache
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_a88950ad624209d564adc425ae5997f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a88950ad624209d564adc425ae5997f2.jpg not downloaded yet
2026-01-28 17:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_36762b1064d9225bc858919c792673d1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6ba09190>
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg saved to cache
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_da428a0bde03954213f7f5a7db8806a6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_da428a0bde03954213f7f5a7db8806a6.jpg not downloaded yet
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_c51ad8c2a754cc569b450407120f6f65.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_c51ad8c2a754cc569b450407120f6f65.jpg not downloaded yet
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN42445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b69819850>
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_36762b1064d9225bc858919c792673d1.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_36762b1064d9225bc858919c792673d1.jpg saved to cache
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_952b171311536a15123c379cdfa51d38.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP90682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY04306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV66931/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB41408> (referer: https://www.auto1.com/v1/car-details-view/HB41408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_7cbf4f38828f950943a949777f7e3f53.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG30508/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_c51ad8c2a754cc569b450407120f6f65.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_4f706cb43d776c92c9c469ba97945c6d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_da428a0bde03954213f7f5a7db8806a6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f9ed0>
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_952b171311536a15123c379cdfa51d38.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_952b171311536a15123c379cdfa51d38.jpg saved to cache
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a88950ad624209d564adc425ae5997f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF70499/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217b86b4-6ee8-5167-8d3c-e805e6dd994b with identifier: HB41408
2026-01-28 17:06:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217b86b4-6ee8-5167-8d3c-e805e6dd994b with scrape type 2
2026-01-28 17:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217b86b4-6ee8-5167-8d3c-e805e6dd994b with scrape type 2
2026-01-28 17:06:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 217b86b4-6ee8-5167-8d3c-e805e6dd994b, identifier: HB41408
2026-01-28 17:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62709a90>
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_7cbf4f38828f950943a949777f7e3f53.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_7cbf4f38828f950943a949777f7e3f53.jpg saved to cache
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63486690>
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_c51ad8c2a754cc569b450407120f6f65.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_c51ad8c2a754cc569b450407120f6f65.jpg saved to cache
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63403c90>
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_4f706cb43d776c92c9c469ba97945c6d.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_4f706cb43d776c92c9c469ba97945c6d.jpg saved to cache
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627e5ed0>
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_da428a0bde03954213f7f5a7db8806a6.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_da428a0bde03954213f7f5a7db8806a6.jpg saved to cache
2026-01-28 17:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 217b86b4-6ee8-5167-8d3c-e805e6dd994b with identifier: HB41408
2026-01-28 17:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 217b86b4-6ee8-5167-8d3c-e805e6dd994b with identifier: HB41408
2026-01-28 17:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 217b86b4-6ee8-5167-8d3c-e805e6dd994b with identifier: HB41408 to the API
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HB41408>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:17:52Z',
 'fuel_type': 'petrol',
 'id': '217b86b4-6ee8-5167-8d3c-e805e6dd994b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB41408',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 79756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT SportLine',
 'transmission': 'manual',
 'trim': 'SportLine',
 'year': 2021}
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HB41408%27 HTTP/1.1" 200 None
2026-01-28 17:06:55 [auto1.es] INFO: Saving data for HB41408: {'auction_closing_time': 1769703472.0, 'created_time': 1767703498.346752, 'last_price_update_time': 1769620015.373427}
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HB41408') HTTP/1.1" 204 0
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ddb10>
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg saved to cache
2026-01-28 17:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626207d0>
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_a88950ad624209d564adc425ae5997f2.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a88950ad624209d564adc425ae5997f2.jpg saved to cache
2026-01-28 17:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293c290>
2026-01-28 17:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg saved to cache
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365dc50>
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg saved to cache
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ13447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a9d9c09a1985be337bfee0f456d5d177.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY27652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR98337/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ25182/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PD89077> (referer: https://www.auto1.com/v1/car-details-view/PD89077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY95486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX61881> (referer: https://www.auto1.com/v1/car-details-view/UX61881/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635b9810>
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg saved to cache
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272c190>
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_a9d9c09a1985be337bfee0f456d5d177.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a9d9c09a1985be337bfee0f456d5d177.jpg saved to cache
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e98542-222a-5e9b-b544-18bb54e4a30b with identifier: PD89077
2026-01-28 17:06:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e98542-222a-5e9b-b544-18bb54e4a30b with scrape type 2
2026-01-28 17:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e98542-222a-5e9b-b544-18bb54e4a30b with scrape type 2
2026-01-28 17:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 23e98542-222a-5e9b-b544-18bb54e4a30b, identifier: PD89077
2026-01-28 17:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a581de1-39e8-534b-a59d-ab87c7b061c0 with identifier: UX61881
2026-01-28 17:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a581de1-39e8-534b-a59d-ab87c7b061c0 with scrape type 2
2026-01-28 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a581de1-39e8-534b-a59d-ab87c7b061c0 with scrape type 2
2026-01-28 17:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2a581de1-39e8-534b-a59d-ab87c7b061c0, identifier: UX61881
2026-01-28 17:06:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a62fd0>
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F69%252Ffc69608e7de57b6d1d61f3e33b55ab70%252Fpa%252FPM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg') HTTP/1.1" 204 0
2026-01-28 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg saved to cache
2026-01-28 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3776172e-7114-51f4-bfa1-23eb04c338cb
2026-01-28 17:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3776172e-7114-51f4-bfa1-23eb04c338cb, skipping ID generation
2026-01-28 17:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3776172e-7114-51f4-bfa1-23eb04c338cb with scrape type 1
2026-01-28 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3776172e-7114-51f4-bfa1-23eb04c338cb from tracking dictionaries
2026-01-28 17:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3776172e-7114-51f4-bfa1-23eb04c338cb sending to next pipeline
2026-01-28 17:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3776172e-7114-51f4-bfa1-23eb04c338cb, identifier: PM05949
2026-01-28 17:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 23e98542-222a-5e9b-b544-18bb54e4a30b with identifier: PD89077
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 23e98542-222a-5e9b-b544-18bb54e4a30b with identifier: PD89077
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23e98542-222a-5e9b-b544-18bb54e4a30b spider: auto1.es
2026-01-28 17:06:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 23e98542-222a-5e9b-b544-18bb54e4a30b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:43:06Z',
 'fuel_type': 'diesel',
 'id': '23e98542-222a-5e9b-b544-18bb54e4a30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD89077',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 129199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-27',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2022}
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PD89077%27 HTTP/1.1" 200 None
2026-01-28 17:06:57 [auto1.es] INFO: Saving data for PD89077: {'auction_closing_time': 1769704986.0, 'created_time': 1768401437.990454, 'last_price_update_time': 1769620017.833421}
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PD89077') HTTP/1.1" 204 0
2026-01-28 17:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2a581de1-39e8-534b-a59d-ab87c7b061c0 with identifier: UX61881
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2a581de1-39e8-534b-a59d-ab87c7b061c0 with identifier: UX61881
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2a581de1-39e8-534b-a59d-ab87c7b061c0 spider: auto1.es
2026-01-28 17:06:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2a581de1-39e8-534b-a59d-ab87c7b061c0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:41:27Z',
 'fuel_type': 'diesel',
 'id': '2a581de1-39e8-534b-a59d-ab87c7b061c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX61881',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 101471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX61881%27 HTTP/1.1" 200 None
2026-01-28 17:06:58 [auto1.es] INFO: Saving data for UX61881: {'auction_closing_time': 1769704887.0, 'created_time': 1768324647.453539, 'last_price_update_time': 1769620018.060301}
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UX61881') HTTP/1.1" 204 0
2026-01-28 17:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3776172e-7114-51f4-bfa1-23eb04c338cb with identifier: PM05949
2026-01-28 17:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3776172e-7114-51f4-bfa1-23eb04c338cb with identifier: PM05949
2026-01-28 17:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3776172e-7114-51f4-bfa1-23eb04c338cb with identifier: PM05949 to the API
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:41:29Z',
 'fuel_type': 'petrol',
 'id': '3776172e-7114-51f4-bfa1-23eb04c338cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM05949',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Fiat',
 'model': '500',
 'odometer': 94862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_9485d4a982d89b80a0f26c5fca09d0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_51d249ee43fe8aa2c6d5256cbf2aa20a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2481706,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_7cbf4f38828f950943a949777f7e3f53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_131c9e921113d3572fdf9e7c7c41e462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a9d9c09a1985be337bfee0f456d5d177.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_44ce7e2ec7fd7d04d6ba28cddac060cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_36762b1064d9225bc858919c792673d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2475337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_6f835dd0bf158d2a09c5f2c2293b01e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_1fa91ca93f2bb9a5a99da96261c4a150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d07eb55c5a6cec9a5c98aa4ba76e5700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_4f706cb43d776c92c9c469ba97945c6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_d7fae37d9942a3a12c0e3e0c63b1ef20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_952b171311536a15123c379cdfa51d38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_a88950ad624209d564adc425ae5997f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_da428a0bde03954213f7f5a7db8806a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3776172e-7114-51f4-bfa1-23eb04c338cb/3776172e-7114-51f4-bfa1-23eb04c338cb_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/69/fc69608e7de57b6d1d61f3e33b55ab70/pa/PM05949_c51ad8c2a754cc569b450407120f6f65.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PM05949%27 HTTP/1.1" 200 None
2026-01-28 17:06:58 [auto1.es] INFO: Saving data for PM05949: {'created_time': 1769620018.444277, 'last_price_update_time': 1769620018.444288, 'auction_closing_time': 1769704889.0}
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PM05949') HTTP/1.1" 204 0
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG30508> (referer: https://www.auto1.com/v1/car-details-view/ZG30508/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES71319> (referer: https://www.auto1.com/v1/car-details-view/ES71319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN42445> (referer: https://www.auto1.com/v1/car-details-view/GN42445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CL61096> (referer: https://www.auto1.com/v1/car-details-view/CL61096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB23846> (referer: https://www.auto1.com/v1/car-details-view/PB23846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b22a4758-df3d-5000-aea0-391654c4e876 with identifier: ZG30508
2026-01-28 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22a4758-df3d-5000-aea0-391654c4e876 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b22a4758-df3d-5000-aea0-391654c4e876 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b22a4758-df3d-5000-aea0-391654c4e876, identifier: ZG30508
2026-01-28 17:06:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b22a4758-df3d-5000-aea0-391654c4e876 with identifier: ZG30508
2026-01-28 17:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b22a4758-df3d-5000-aea0-391654c4e876 with identifier: ZG30508
2026-01-28 17:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:06:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b22a4758-df3d-5000-aea0-391654c4e876 spider: auto1.es
2026-01-28 17:06:59 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b22a4758-df3d-5000-aea0-391654c4e876 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:04:06Z',
 'fuel_type': 'diesel',
 'id': 'b22a4758-df3d-5000-aea0-391654c4e876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG30508',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 101964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-01-28 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZG30508%27 HTTP/1.1" 200 None
2026-01-28 17:06:59 [auto1.es] INFO: Saving data for ZG30508: {'auction_closing_time': 1769702646.0, 'created_time': 1768410196.054931, 'last_price_update_time': 1769620019.674143}
2026-01-28 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG30508') HTTP/1.1" 204 0
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF70499> (referer: https://www.auto1.com/v1/car-details-view/AF70499/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG47360> (referer: https://www.auto1.com/v1/car-details-view/HG47360/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:06:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f42cc9da-cbc0-5307-902b-82a52d4919e0 with identifier: ES71319
2026-01-28 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f42cc9da-cbc0-5307-902b-82a52d4919e0 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f42cc9da-cbc0-5307-902b-82a52d4919e0 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f42cc9da-cbc0-5307-902b-82a52d4919e0, identifier: ES71319
2026-01-28 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 with identifier: GN42445
2026-01-28 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284, identifier: GN42445
2026-01-28 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2026-01-28 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca465372-b003-53dc-be64-3a7bea5058cf with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca465372-b003-53dc-be64-3a7bea5058cf with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ca465372-b003-53dc-be64-3a7bea5058cf, identifier: CL61096
2026-01-28 17:06:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-01-28 17:06:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a34a06-dafc-550b-a299-de49e9c4be7a with scrape type 2
2026-01-28 17:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a34a06-dafc-550b-a299-de49e9c4be7a with scrape type 2
2026-01-28 17:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 51a34a06-dafc-550b-a299-de49e9c4be7a, identifier: PB23846
2026-01-28 17:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f42cc9da-cbc0-5307-902b-82a52d4919e0 with identifier: ES71319
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f42cc9da-cbc0-5307-902b-82a52d4919e0 with identifier: ES71319
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200 evalia' containing 'nv'
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f42cc9da-cbc0-5307-902b-82a52d4919e0 spider: auto1.es
2026-01-28 17:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f42cc9da-cbc0-5307-902b-82a52d4919e0 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'nissan' containing 'nissan' and model 'nv200 evalia' containing 'nv'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:55:48Z',
 'fuel_type': 'diesel',
 'id': 'f42cc9da-cbc0-5307-902b-82a52d4919e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES71319',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 67278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi NV200 Furgón Basic',
 'transmission': 'manual',
 'trim': 'NV200 Furgón Basic',
 'year': 2017}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES71319%27 HTTP/1.1" 200 None
2026-01-28 17:07:00 [auto1.es] INFO: Saving data for ES71319: {'auction_closing_time': 1769705748.0, 'created_time': 1769065310.570574, 'last_price_update_time': 1769620020.32569}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES71319') HTTP/1.1" 204 0
2026-01-28 17:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 with identifier: GN42445
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 with identifier: GN42445
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 102223, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gn42445', 'expiration_date': '2026-01-29t16:41:24z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '5e3e4b24-0b69-5531-8ec1-e1d1c92ba284', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 102223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:41:24z',
     'fuel_type': 'electro',
     'id': '5e3e4b24-0b69-5531-8ec1-e1d1c92ba284',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gn42445',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 102223,
     'odometer_in_km': 102223,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 spider: auto1.es
2026-01-28 17:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5e3e4b24-0b69-5531-8ec1-e1d1c92ba284 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 102223, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gn42445', 'expiration_date': '2026-01-29t16:41:24z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': '5e3e4b24-0b69-5531-8ec1-e1d1c92ba284', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 102223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:41:24z',
     'fuel_type': 'electro',
     'id': '5e3e4b24-0b69-5531-8ec1-e1d1c92ba284',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gn42445',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 102223,
     'odometer_in_km': 102223,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:41:24Z',
 'fuel_type': 'electro',
 'id': '5e3e4b24-0b69-5531-8ec1-e1d1c92ba284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN42445',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 102223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN42445%27 HTTP/1.1" 200 None
2026-01-28 17:07:00 [auto1.es] INFO: Saving data for GN42445: {'auction_closing_time': 1769704884.0, 'created_time': 1768401370.250422, 'last_price_update_time': 1769620020.551296}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GN42445') HTTP/1.1" 204 0
2026-01-28 17:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ca465372-b003-53dc-be64-3a7bea5058cf with identifier: CL61096
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131370 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131370
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ca465372-b003-53dc-be64-3a7bea5058cf spider: auto1.es
2026-01-28 17:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ca465372-b003-53dc-be64-3a7bea5058cf due to rule: high_mileage_for_make.json, error: 131370 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131370
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:54:33Z',
 'fuel_type': 'diesel',
 'id': 'ca465372-b003-53dc-be64-3a7bea5058cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL61096',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 131370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CL61096%27 HTTP/1.1" 200 None
2026-01-28 17:07:00 [auto1.es] INFO: Saving data for CL61096: {'auction_closing_time': 1769705673.0, 'created_time': 1768237751.420938, 'last_price_update_time': 1769620020.77858}
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CL61096') HTTP/1.1" 204 0
2026-01-28 17:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-01-28 17:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846
2026-01-28 17:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 51a34a06-dafc-550b-a299-de49e9c4be7a with identifier: PB23846 to the API
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PB23846>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:41:27Z',
 'fuel_type': 'petrol',
 'id': '51a34a06-dafc-550b-a299-de49e9c4be7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB23846',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 117373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2022}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PB23846%27 HTTP/1.1" 200 None
2026-01-28 17:07:01 [auto1.es] INFO: Saving data for PB23846: {'auction_closing_time': 1769704887.0, 'created_time': 1768324234.876309, 'last_price_update_time': 1769620021.160439}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PB23846') HTTP/1.1" 204 0
2026-01-28 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GU10653> (referer: https://www.auto1.com/v1/car-details-view/GU10653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de38299b-4791-5717-b4eb-84c9a53f0033 with identifier: AF70499
2026-01-28 17:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de38299b-4791-5717-b4eb-84c9a53f0033 with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de38299b-4791-5717-b4eb-84c9a53f0033 with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de38299b-4791-5717-b4eb-84c9a53f0033, identifier: AF70499
2026-01-28 17:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea with identifier: HG47360
2026-01-28 17:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea, identifier: HG47360
2026-01-28 17:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de38299b-4791-5717-b4eb-84c9a53f0033 with identifier: AF70499
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de38299b-4791-5717-b4eb-84c9a53f0033 with identifier: AF70499
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 118306, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af70499', 'expiration_date': '2026-01-29t16:43:58z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': 'de38299b-4791-5717-b4eb-84c9a53f0033', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 118306}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:43:58z',
     'fuel_type': 'electro',
     'id': 'de38299b-4791-5717-b4eb-84c9a53f0033',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af70499',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 118306,
     'odometer_in_km': 118306,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: de38299b-4791-5717-b4eb-84c9a53f0033 spider: auto1.es
2026-01-28 17:07:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: de38299b-4791-5717-b4eb-84c9a53f0033 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 118306, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af70499', 'expiration_date': '2026-01-29t16:43:58z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': 'de38299b-4791-5717-b4eb-84c9a53f0033', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 118306}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:43:58z',
     'fuel_type': 'electro',
     'id': 'de38299b-4791-5717-b4eb-84c9a53f0033',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/af70499',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 118306,
     'odometer_in_km': 118306,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:43:58Z',
 'fuel_type': 'electro',
 'id': 'de38299b-4791-5717-b4eb-84c9a53f0033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF70499',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 118306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AF70499%27 HTTP/1.1" 200 None
2026-01-28 17:07:01 [auto1.es] INFO: Saving data for AF70499: {'auction_closing_time': 1769705038.0, 'created_time': 1768410361.123593, 'last_price_update_time': 1769620021.581872}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AF70499') HTTP/1.1" 204 0
2026-01-28 17:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea with identifier: HG47360
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea with identifier: HG47360
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea spider: auto1.es
2026-01-28 17:07:01 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:39:57Z',
 'fuel_type': 'diesel',
 'id': '5ea1e926-c4fd-5a4f-8c74-724cc94ee4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG47360',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 86557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HG47360%27 HTTP/1.1" 200 None
2026-01-28 17:07:01 [auto1.es] INFO: Saving data for HG47360: {'auction_closing_time': 1769704797.0, 'created_time': 1769101549.267966, 'last_price_update_time': 1769620021.816458}
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HG47360') HTTP/1.1" 204 0
2026-01-28 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU77979/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ16571/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24d4e445-556e-5f36-96a8-c9cec5867b3f with identifier: GU10653
2026-01-28 17:07:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24d4e445-556e-5f36-96a8-c9cec5867b3f with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24d4e445-556e-5f36-96a8-c9cec5867b3f with scrape type 2
2026-01-28 17:07:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 24d4e445-556e-5f36-96a8-c9cec5867b3f, identifier: GU10653
2026-01-28 17:07:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 24d4e445-556e-5f36-96a8-c9cec5867b3f with identifier: GU10653
2026-01-28 17:07:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 24d4e445-556e-5f36-96a8-c9cec5867b3f with identifier: GU10653
2026-01-28 17:07:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 24d4e445-556e-5f36-96a8-c9cec5867b3f with identifier: GU10653 to the API
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GU10653>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '',
 'engine_horse_power': 118,
 'expiration_date': '2026-01-29T16:53:37Z',
 'fuel_type': 'electro',
 'id': '24d4e445-556e-5f36-96a8-c9cec5867b3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU10653',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500e',
 'odometer': 77923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-25',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat 500e electric drive 87 kW Icon',
 'transmission': 'automatic',
 'trim': 'Icon',
 'year': 2022}
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GU10653%27 HTTP/1.1" 200 None
2026-01-28 17:07:02 [auto1.es] INFO: Saving data for GU10653: {'auction_closing_time': 1769705617.0, 'created_time': 1769101633.15781, 'last_price_update_time': 1769620022.271129}
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GU10653') HTTP/1.1" 204 0
2026-01-28 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZP90682> (referer: https://www.auto1.com/v1/car-details-view/ZP90682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV66931> (referer: https://www.auto1.com/v1/car-details-view/LV66931/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c339353-4386-5df5-b089-7d61f277501c with identifier: ZP90682
2026-01-28 17:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c339353-4386-5df5-b089-7d61f277501c with scrape type 2
2026-01-28 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c339353-4386-5df5-b089-7d61f277501c with scrape type 2
2026-01-28 17:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0c339353-4386-5df5-b089-7d61f277501c, identifier: ZP90682
2026-01-28 17:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0c339353-4386-5df5-b089-7d61f277501c with identifier: ZP90682
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0c339353-4386-5df5-b089-7d61f277501c with identifier: ZP90682
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 104694, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp90682', 'expiration_date': '2026-01-29t16:14:32z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0c339353-4386-5df5-b089-7d61f277501c', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 104694}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:14:32z',
     'fuel_type': 'electro',
     'id': '0c339353-4386-5df5-b089-7d61f277501c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp90682',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 104694,
     'odometer_in_km': 104694,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 0c339353-4386-5df5-b089-7d61f277501c spider: auto1.es
2026-01-28 17:07:02 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0c339353-4386-5df5-b089-7d61f277501c due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 104694, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp90682', 'expiration_date': '2026-01-29t16:14:32z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '0c339353-4386-5df5-b089-7d61f277501c', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 104694}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:14:32z',
     'fuel_type': 'electro',
     'id': '0c339353-4386-5df5-b089-7d61f277501c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/zp90682',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 104694,
     'odometer_in_km': 104694,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:14:32Z',
 'fuel_type': 'electro',
 'id': '0c339353-4386-5df5-b089-7d61f277501c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP90682',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 104694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP90682%27 HTTP/1.1" 200 None
2026-01-28 17:07:02 [auto1.es] INFO: Saving data for ZP90682: {'auction_closing_time': 1769703272.0, 'created_time': 1768323796.020214, 'last_price_update_time': 1769620022.701168}
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZP90682') HTTP/1.1" 204 0
2026-01-28 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF05648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX91241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49bfc814-5bee-5482-b533-2acc29669a2d with identifier: LV66931
2026-01-28 17:07:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49bfc814-5bee-5482-b533-2acc29669a2d with scrape type 2
2026-01-28 17:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49bfc814-5bee-5482-b533-2acc29669a2d with scrape type 2
2026-01-28 17:07:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49bfc814-5bee-5482-b533-2acc29669a2d, identifier: LV66931
2026-01-28 17:07:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49bfc814-5bee-5482-b533-2acc29669a2d with identifier: LV66931
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49bfc814-5bee-5482-b533-2acc29669a2d with identifier: LV66931
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 110370, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv66931', 'expiration_date': '2026-01-29t16:10:00z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '49bfc814-5bee-5482-b533-2acc29669a2d', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 110370}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:10:00z',
     'fuel_type': 'electro',
     'id': '49bfc814-5bee-5482-b533-2acc29669a2d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv66931',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 110370,
     'odometer_in_km': 110370,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 49bfc814-5bee-5482-b533-2acc29669a2d spider: auto1.es
2026-01-28 17:07:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 49bfc814-5bee-5482-b533-2acc29669a2d due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 110370, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv66931', 'expiration_date': '2026-01-29t16:10:00z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '49bfc814-5bee-5482-b533-2acc29669a2d', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 110370}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:10:00z',
     'fuel_type': 'electro',
     'id': '49bfc814-5bee-5482-b533-2acc29669a2d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/lv66931',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 110370,
     'odometer_in_km': 110370,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:10:00Z',
 'fuel_type': 'electro',
 'id': '49bfc814-5bee-5482-b533-2acc29669a2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV66931',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 110370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LV66931%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Saving data for LV66931: {'auction_closing_time': 1769703000.0, 'created_time': 1768410360.492753, 'last_price_update_time': 1769620023.038289}
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LV66931') HTTP/1.1" 204 0
2026-01-28 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:03 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: SU76295
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU76295%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for SU76295: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: WU95928
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU95928%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for WU95928: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: TU48427
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU48427%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for TU48427: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: BR03332
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR03332%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for BR03332: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: AB74066
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB74066%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for AB74066: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: AC08387
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC08387%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for AC08387: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: LD85215
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD85215%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for LD85215: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: FZ98795
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ98795%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for FZ98795: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: GH73638
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH73638%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for GH73638: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: JW95556
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW95556%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for JW95556: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: PX76519
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for PX76519: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: AH18872
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH18872%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for AH18872: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: TB32811
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB32811%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for TB32811: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: FB08932
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB08932%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for FB08932: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: PH24007
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH24007%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for PH24007: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: ME28705
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME28705%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for ME28705: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: EW08330
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW08330%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for EW08330: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: KL07706
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for KL07706: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: UL07014
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL07014%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for UL07014: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: SD57471
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD57471%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for SD57471: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: HM90480
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM90480%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for HM90480: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: TN12809
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN12809%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for TN12809: 2
2026-01-28 17:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY95486> (referer: https://www.auto1.com/v1/car-details-view/SY95486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: GD68452
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD68452%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for GD68452: 2
2026-01-28 17:07:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: FM65148
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM65148%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for FM65148: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: SM82482
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM82482%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for SM82482: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: TR17798
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR17798%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for TR17798: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: ES82633
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for ES82633: 2
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: RV71834
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV71834%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for RV71834: 1
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: BR83507
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR83507%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for BR83507: 1
2026-01-28 17:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 with identifier: SY95486
2026-01-28 17:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 with scrape type 2
2026-01-28 17:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 with scrape type 2
2026-01-28 17:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37, identifier: SY95486
2026-01-28 17:07:03 [auto1.es] INFO: Found listing with ID: PH10774
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-01-28 17:07:03 [auto1.es] INFO: Scrape type for PH10774: 2
2026-01-28 17:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 with identifier: SY95486
2026-01-28 17:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 with identifier: SY95486
2026-01-28 17:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 spider: auto1.es
2026-01-28 17:07:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7f1a9f12-bc52-5f5d-a81c-073dd02deb37 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:51:16Z',
 'fuel_type': 'diesel',
 'id': '7f1a9f12-bc52-5f5d-a81c-073dd02deb37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY95486',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 102247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SY95486%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Saving data for SY95486: {'auction_closing_time': 1769705476.0, 'created_time': 1768324543.346974, 'last_price_update_time': 1769620024.064544}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SY95486') HTTP/1.1" 204 0
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ25182> (referer: https://www.auto1.com/v1/car-details-view/RZ25182/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: YU81680
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU81680%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for YU81680: 1
2026-01-28 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY04306> (referer: https://www.auto1.com/v1/car-details-view/TY04306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY27652> (referer: https://www.auto1.com/v1/car-details-view/EY27652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG50719> (referer: https://www.auto1.com/v1/car-details-view/VG50719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ13447> (referer: https://www.auto1.com/v1/car-details-view/UZ13447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: NJ71471
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ71471%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for NJ71471: 2
2026-01-28 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: LP64898
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP64898%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for LP64898: 2
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: XD08126
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD08126%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for XD08126: 2
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: VT60667
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT60667%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for VT60667: 1
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: LA81893
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA81893%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for LA81893: 1
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: YV54140
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV54140%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for YV54140: 1
2026-01-28 17:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25cd5cbc-7688-5e16-8875-c4c5f6106956 with identifier: RZ25182
2026-01-28 17:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25cd5cbc-7688-5e16-8875-c4c5f6106956 with scrape type 2
2026-01-28 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25cd5cbc-7688-5e16-8875-c4c5f6106956 with scrape type 2
2026-01-28 17:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 25cd5cbc-7688-5e16-8875-c4c5f6106956, identifier: RZ25182
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: UK62633
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK62633%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for UK62633: 1
2026-01-28 17:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 25cd5cbc-7688-5e16-8875-c4c5f6106956 with identifier: RZ25182
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 25cd5cbc-7688-5e16-8875-c4c5f6106956 with identifier: RZ25182
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 25cd5cbc-7688-5e16-8875-c4c5f6106956 spider: auto1.es
2026-01-28 17:07:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 25cd5cbc-7688-5e16-8875-c4c5f6106956 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:50:14Z',
 'fuel_type': 'electro',
 'id': '25cd5cbc-7688-5e16-8875-c4c5f6106956',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ25182',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 45010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit electric drive 135 kW L3 Trend',
 'transmission': 'automatic',
 'trim': 'L3 Trend',
 'year': 2022}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ25182%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Saving data for RZ25182: {'auction_closing_time': 1769705414.0, 'created_time': 1768237753.767009, 'last_price_update_time': 1769620024.624035}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ25182') HTTP/1.1" 204 0
2026-01-28 17:07:04 [scrapy.extensions.logstats] INFO: Crawled 982 pages (at 121 pages/min), scraped 263 items (at 28 items/min)
2026-01-28 17:07:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 with identifier: TY04306
2026-01-28 17:07:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 with scrape type 2
2026-01-28 17:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 with scrape type 2
2026-01-28 17:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0, identifier: TY04306
2026-01-28 17:07:04 [auto1.es] INFO: Found listing with ID: ND84609
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND84609%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Scrape type for ND84609: 2
2026-01-28 17:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA44811> (referer: https://www.auto1.com/v1/car-details-view/MA44811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 with identifier: TY04306
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 with identifier: TY04306
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 117974, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty04306', 'expiration_date': '2026-01-29t16:53:35z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '19162f45-96f3-5b19-b2ff-9e2904f6cfb0', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 117974}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:53:35z',
     'fuel_type': 'electro',
     'id': '19162f45-96f3-5b19-b2ff-9e2904f6cfb0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty04306',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 117974,
     'odometer_in_km': 117974,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 spider: auto1.es
2026-01-28 17:07:04 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 19162f45-96f3-5b19-b2ff-9e2904f6cfb0 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 117974, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty04306', 'expiration_date': '2026-01-29t16:53:35z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '19162f45-96f3-5b19-b2ff-9e2904f6cfb0', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 117974}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:53:35z',
     'fuel_type': 'electro',
     'id': '19162f45-96f3-5b19-b2ff-9e2904f6cfb0',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ty04306',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 117974,
     'odometer_in_km': 117974,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:53:35Z',
 'fuel_type': 'electro',
 'id': '19162f45-96f3-5b19-b2ff-9e2904f6cfb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY04306',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 117974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TY04306%27 HTTP/1.1" 200 None
2026-01-28 17:07:04 [auto1.es] INFO: Saving data for TY04306: {'auction_closing_time': 1769705615.0, 'created_time': 1768323714.609582, 'last_price_update_time': 1769620024.98748}
2026-01-28 17:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TY04306') HTTP/1.1" 204 0
2026-01-28 17:07:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:05 [auto1.es] INFO: Found listing with ID: VR29926
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-01-28 17:07:05 [auto1.es] INFO: Scrape type for VR29926: 1
2026-01-28 17:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6abda6ec-d247-5d46-82cd-e1903d5caf5e with identifier: EY27652
2026-01-28 17:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6abda6ec-d247-5d46-82cd-e1903d5caf5e with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6abda6ec-d247-5d46-82cd-e1903d5caf5e with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6abda6ec-d247-5d46-82cd-e1903d5caf5e, identifier: EY27652
2026-01-28 17:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with identifier: VG50719
2026-01-28 17:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d41e1dbe-c4e6-5b35-b9db-5a36521607a8, identifier: VG50719
2026-01-28 17:07:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-01-28 17:07:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a7e453a-812e-53c3-a3ab-104a9941c974 with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a7e453a-812e-53c3-a3ab-104a9941c974 with scrape type 2
2026-01-28 17:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4a7e453a-812e-53c3-a3ab-104a9941c974, identifier: UZ13447
2026-01-28 17:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6abda6ec-d247-5d46-82cd-e1903d5caf5e with identifier: EY27652
2026-01-28 17:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6abda6ec-d247-5d46-82cd-e1903d5caf5e with identifier: EY27652
2026-01-28 17:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 87922, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ey27652', 'expiration_date': '2026-01-29t16:58:43z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6abda6ec-d247-5d46-82cd-e1903d5caf5e', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 87922}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:58:43z',
     'fuel_type': 'electro',
     'id': '6abda6ec-d247-5d46-82cd-e1903d5caf5e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ey27652',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 87922,
     'odometer_in_km': 87922,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 6abda6ec-d247-5d46-82cd-e1903d5caf5e spider: auto1.es
2026-01-28 17:07:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6abda6ec-d247-5d46-82cd-e1903d5caf5e due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 87922, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ey27652', 'expiration_date': '2026-01-29t16:58:43z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '6abda6ec-d247-5d46-82cd-e1903d5caf5e', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 87922}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:58:43z',
     'fuel_type': 'electro',
     'id': '6abda6ec-d247-5d46-82cd-e1903d5caf5e',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ey27652',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 87922,
     'odometer_in_km': 87922,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:58:43Z',
 'fuel_type': 'electro',
 'id': '6abda6ec-d247-5d46-82cd-e1903d5caf5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY27652',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 87922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY27652%27 HTTP/1.1" 200 None
2026-01-28 17:07:05 [auto1.es] INFO: Saving data for EY27652: {'auction_closing_time': 1769705923.0, 'created_time': 1768402078.835527, 'last_price_update_time': 1769620025.5412}
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY27652') HTTP/1.1" 204 0
2026-01-28 17:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with identifier: VG50719
2026-01-28 17:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with identifier: VG50719
2026-01-28 17:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d41e1dbe-c4e6-5b35-b9db-5a36521607a8 with identifier: VG50719 to the API
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VG50719>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:13:57Z',
 'fuel_type': 'diesel',
 'id': 'd41e1dbe-c4e6-5b35-b9db-5a36521607a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG50719',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 116462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2020}
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VG50719%27 HTTP/1.1" 200 None
2026-01-28 17:07:05 [auto1.es] INFO: Saving data for VG50719: {'auction_closing_time': 1769703237.0, 'created_time': 1768402030.378699, 'last_price_update_time': 1769620025.855764}
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VG50719') HTTP/1.1" 204 0
2026-01-28 17:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-01-28 17:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447
2026-01-28 17:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4a7e453a-812e-53c3-a3ab-104a9941c974 with identifier: UZ13447 to the API
2026-01-28 17:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UZ13447>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:53:09Z',
 'fuel_type': 'diesel',
 'id': '4a7e453a-812e-53c3-a3ab-104a9941c974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ13447',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 146729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2022}
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UZ13447%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [auto1.es] INFO: Saving data for UZ13447: {'auction_closing_time': 1769705589.0, 'created_time': 1768401377.040894, 'last_price_update_time': 1769620026.198351}
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UZ13447') HTTP/1.1" 204 0
2026-01-28 17:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6802e14d-9b8f-59f7-b77b-5d5e0a378834 with identifier: MA44811
2026-01-28 17:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6802e14d-9b8f-59f7-b77b-5d5e0a378834 with scrape type 1
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6802e14d-9b8f-59f7-b77b-5d5e0a378834
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_52adc3d55f940c940b38aa60fbbb6027.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_f569fb999bec07369222299a67f1057c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_637185b2f15fde21f98f1555add17f15.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_9e8aba49694575f072fadae8c0b7ccee.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_02d8cd30f38fbb975388aa50bf209e84.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_5ee7dce317474d301c7011aaf3432ff7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_43c0596585a4884f8b45dab4932a46a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_76696eb81a9da5f44465f038825b59a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_abf80af097ca21b961bdfbf27d98d35f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg already downloaded
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F96%252F3496fd7153897296815ea00eb03cf62d%252Fpa%252FMA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg already downloaded
2026-01-28 17:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6802e14d-9b8f-59f7-b77b-5d5e0a378834, identifier: MA44811
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN50898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU77979> (referer: https://www.auto1.com/v1/car-details-view/KU77979/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ16571> (referer: https://www.auto1.com/v1/car-details-view/XZ16571/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL95090/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF45409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6802e14d-9b8f-59f7-b77b-5d5e0a378834 with identifier: MA44811
2026-01-28 17:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6802e14d-9b8f-59f7-b77b-5d5e0a378834 with identifier: MA44811
2026-01-28 17:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 turbodiesel limited 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'automatic', 'odometer': 105519, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma44811', 'expiration_date': '2026-01-29t16:52:23z', 'origin_country_code': 'es', 'trim': 'limited 4x2', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, hellin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 146, 'id': '6802e14d-9b8f-59f7-b77b-5d5e0a378834', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76921}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80405}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81303}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75241}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47120}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64805}], 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 105519}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:52:23z',
     'fuel_type': 'diesel',
     'id': '6802e14d-9b8f-59f7-b77b-5d5e0a378834',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma44811',
     'listing': 'auction',
     'location': 'es, hellin',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 105519,
     'odometer_in_km': 105519,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86566,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85597,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76921,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68865,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66923,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89750,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80405,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86321,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81303,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82861,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75241,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75077,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47120,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64805,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-08',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 turbodiesel limited 4x2',
     'transmission': 'automatic',
     'trim': 'limited 4x2',
     'year': 2018}
2026-01-28 17:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 6802e14d-9b8f-59f7-b77b-5d5e0a378834 spider: auto1.es
2026-01-28 17:07:06 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 6802e14d-9b8f-59f7-b77b-5d5e0a378834 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.6 turbodiesel limited 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'automatic', 'odometer': 105519, 'odometer_reading_unit': 'km', 'registration_date': '2018-03-08', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma44811', 'expiration_date': '2026-01-29t16:52:23z', 'origin_country_code': 'es', 'trim': 'limited 4x2', 'year': 2018, 'fuel_type': 'diesel', 'listing': 'auction', 'engine_horse_power': 115, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg', 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.6l', 'location': 'es, hellin', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 146, 'id': '6802e14d-9b8f-59f7-b77b-5d5e0a378834', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86566}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76921}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 68865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66923}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89750}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80405}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81303}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 82861}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75241}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73349}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 75077}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 47120}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 64805}], 'current_year_diff': 8, 'age_in_months': 94, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 105519}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 94,
     'auction_title': '',
     'c_o_2_emission_value': 146,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'engine_horse_power': 115,
     'expiration_date': '2026-01-29t16:52:23z',
     'fuel_type': 'diesel',
     'id': '6802e14d-9b8f-59f7-b77b-5d5e0a378834',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ma44811',
     'listing': 'auction',
     'location': 'es, hellin',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 105519,
     'odometer_in_km': 105519,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
                    'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86566,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85597,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76921,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 68865,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66923,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89750,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80405,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86321,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81303,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 82861,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75241,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73349,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 75077,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 47120,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 64805,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-03-08',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.6 turbodiesel limited 4x2',
     'transmission': 'automatic',
     'trim': 'limited 4x2',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:52:23Z',
 'fuel_type': 'diesel',
 'id': '6802e14d-9b8f-59f7-b77b-5d5e0a378834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA44811',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 105519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
                'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_52adc3d55f940c940b38aa60fbbb6027.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_94936c4f395ed18a85f2c1fa777e4efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f569fb999bec07369222299a67f1057c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_637185b2f15fde21f98f1555add17f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_9e8aba49694575f072fadae8c0b7ccee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_02d8cd30f38fbb975388aa50bf209e84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c2bce51f329c17351c6ebd7f3f0346f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_f4ed6ef94fb4136c6b65191c7225c02b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_5ee7dce317474d301c7011aaf3432ff7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82861,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_be4256b362a8daa7d94129cd9dbabd4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_43c0596585a4884f8b45dab4932a46a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_76696eb81a9da5f44465f038825b59a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_225b3c62e09ae2f25b1236019b0f1da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_c1ca246772b8b8c23a74ea07b8c33647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_abf80af097ca21b961bdfbf27d98d35f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6802e14d-9b8f-59f7-b77b-5d5e0a378834/6802e14d-9b8f-59f7-b77b-5d5e0a378834_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img34/96/3496fd7153897296815ea00eb03cf62d/pa/MA44811_d1e09c59395652f57d6d7b1a9fa19380.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.6 Turbodiesel Limited 4x2',
 'transmission': 'automatic',
 'trim': 'Limited 4x2',
 'year': 2018}
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MA44811%27 HTTP/1.1" 200 None
2026-01-28 17:07:06 [auto1.es] INFO: Saving data for MA44811: {'created_time': 1769620026.871014, 'last_price_update_time': 1769620026.871024, 'auction_closing_time': 1769705543.0}
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MA44811') HTTP/1.1" 204 0
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH03418> (referer: https://www.auto1.com/v1/car-details-view/SH03418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR98337> (referer: https://www.auto1.com/v1/car-details-view/WR98337/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caee185f-c32b-52df-9d30-5ed747efe5bc with identifier: KU77979
2026-01-28 17:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caee185f-c32b-52df-9d30-5ed747efe5bc with scrape type 2
2026-01-28 17:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caee185f-c32b-52df-9d30-5ed747efe5bc with scrape type 2
2026-01-28 17:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: caee185f-c32b-52df-9d30-5ed747efe5bc, identifier: KU77979
2026-01-28 17:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-01-28 17:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e54af9e9-ef54-5f37-8f1f-025919b039be with scrape type 2
2026-01-28 17:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e54af9e9-ef54-5f37-8f1f-025919b039be with scrape type 2
2026-01-28 17:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e54af9e9-ef54-5f37-8f1f-025919b039be, identifier: XZ16571
2026-01-28 17:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: caee185f-c32b-52df-9d30-5ed747efe5bc with identifier: KU77979
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: caee185f-c32b-52df-9d30-5ed747efe5bc with identifier: KU77979
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: caee185f-c32b-52df-9d30-5ed747efe5bc spider: auto1.es
2026-01-28 17:07:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: caee185f-c32b-52df-9d30-5ed747efe5bc due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 184,
 'expiration_date': '2026-01-29T16:40:46Z',
 'fuel_type': 'electro',
 'id': 'caee185f-c32b-52df-9d30-5ed747efe5bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU77979',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 65622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit electric drive 135 kW L3 Trend',
 'transmission': 'automatic',
 'trim': 'L3 Trend',
 'year': 2022}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU77979%27 HTTP/1.1" 200 None
2026-01-28 17:07:07 [auto1.es] INFO: Saving data for KU77979: {'auction_closing_time': 1769704846.0, 'created_time': 1768237750.611787, 'last_price_update_time': 1769620027.29544}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU77979') HTTP/1.1" 204 0
2026-01-28 17:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571
2026-01-28 17:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e54af9e9-ef54-5f37-8f1f-025919b039be with identifier: XZ16571 to the API
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XZ16571>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:23:01Z',
 'fuel_type': 'diesel',
 'id': 'e54af9e9-ef54-5f37-8f1f-025919b039be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ16571',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 56838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.5 CDTI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2021}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ16571%27 HTTP/1.1" 200 None
2026-01-28 17:07:07 [auto1.es] INFO: Saving data for XZ16571: {'auction_closing_time': 1769703781.0, 'created_time': 1768401168.591171, 'last_price_update_time': 1769620027.609411}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XZ16571') HTTP/1.1" 204 0
2026-01-28 17:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-01-28 17:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with scrape type 1
2026-01-28 17:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg not downloaded yet
2026-01-28 17:07:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb48962b-d570-53e7-8200-6cf702f79852 with identifier: WR98337
2026-01-28 17:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb48962b-d570-53e7-8200-6cf702f79852 with scrape type 2
2026-01-28 17:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb48962b-d570-53e7-8200-6cf702f79852 with scrape type 2
2026-01-28 17:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb48962b-d570-53e7-8200-6cf702f79852, identifier: WR98337
2026-01-28 17:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb48962b-d570-53e7-8200-6cf702f79852 with identifier: WR98337
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb48962b-d570-53e7-8200-6cf702f79852 with identifier: WR98337
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 98784, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wr98337', 'expiration_date': '2026-01-29t16:53:03z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'eb48962b-d570-53e7-8200-6cf702f79852', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 98784}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:53:03z',
     'fuel_type': 'electro',
     'id': 'eb48962b-d570-53e7-8200-6cf702f79852',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wr98337',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 98784,
     'odometer_in_km': 98784,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
2026-01-28 17:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: eb48962b-d570-53e7-8200-6cf702f79852 spider: auto1.es
2026-01-28 17:07:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: eb48962b-d570-53e7-8200-6cf702f79852 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l2h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 98784, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-23', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wr98337', 'expiration_date': '2026-01-29t16:53:03z', 'origin_country_code': 'es', 'trim': 'l2h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'eb48962b-d570-53e7-8200-6cf702f79852', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 98784}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'emission_standard': 'euro 6',
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:53:03z',
     'fuel_type': 'electro',
     'id': 'eb48962b-d570-53e7-8200-6cf702f79852',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wr98337',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 98784,
     'odometer_in_km': 98784,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-23',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l2h1',
     'transmission': 'automatic',
     'trim': 'l2h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:53:03Z',
 'fuel_type': 'electro',
 'id': 'eb48962b-d570-53e7-8200-6cf702f79852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR98337',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 98784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-23',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L2H1',
 'transmission': 'automatic',
 'trim': 'L2H1',
 'year': 2022}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WR98337%27 HTTP/1.1" 200 None
2026-01-28 17:07:07 [auto1.es] INFO: Saving data for WR98337: {'auction_closing_time': 1769705583.0, 'created_time': 1768401075.875196, 'last_price_update_time': 1769620027.962786}
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WR98337') HTTP/1.1" 204 0
2026-01-28 17:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg not downloaded yet
2026-01-28 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN08984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg not downloaded yet
2026-01-28 17:07:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_56d832c2b8d510a028c3e1a477796917.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_56d832c2b8d510a028c3e1a477796917.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_441f527367318b8c04a1f46ccb90225d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_441f527367318b8c04a1f46ccb90225d.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_241a02701b488b023396374de1f5675c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_241a02701b488b023396374de1f5675c.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_d83842b3c665d8a8289112fc17a0f500.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d83842b3c665d8a8289112fc17a0f500.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_d66fd667498a7e2e86e4405f669077cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d66fd667498a7e2e86e4405f669077cc.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_7e660ccf4970c45e188fc2829925ea65.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7e660ccf4970c45e188fc2829925ea65.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_81c88cf09cd63823e458f48b4286ebcd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_81c88cf09cd63823e458f48b4286ebcd.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_1e1e45641810078ec21a7946e761ae0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1e1e45641810078ec21a7946e761ae0e.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_c436da7c129fb530f504441f66cb98c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_c436da7c129fb530f504441f66cb98c9.jpg not downloaded yet
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg not downloaded yet
2026-01-28 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a61e10>
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg saved to cache
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634b8110>
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg saved to cache
2026-01-28 17:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_c436da7c129fb530f504441f66cb98c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES82633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND84609/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY84570> (referer: https://www.auto1.com/v1/car-details-view/GY84570/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU81680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR83507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340bd10>
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_c436da7c129fb530f504441f66cb98c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_c436da7c129fb530f504441f66cb98c9.jpg saved to cache
2026-01-28 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1e1e45641810078ec21a7946e761ae0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_81c88cf09cd63823e458f48b4286ebcd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH10774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN12809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 with identifier: GY84570
2026-01-28 17:07:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 with scrape type 2
2026-01-28 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 with scrape type 2
2026-01-28 17:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960, identifier: GY84570
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 with identifier: GY84570
2026-01-28 17:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 with identifier: GY84570
2026-01-28 17:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 spider: auto1.es
2026-01-28 17:07:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2c0bcb39-58b6-55c3-8b8a-5b030c81f960 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:52:32Z',
 'fuel_type': 'diesel',
 'id': '2c0bcb39-58b6-55c3-8b8a-5b030c81f960',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY84570',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 67557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-07-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Contrlol M',
 'transmission': 'manual',
 'trim': 'Contrlol M',
 'year': 2020}
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GY84570%27 HTTP/1.1" 200 None
2026-01-28 17:07:09 [auto1.es] INFO: Saving data for GY84570: {'auction_closing_time': 1769705552.0, 'created_time': 1769002973.497221, 'last_price_update_time': 1769620029.68726}
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GY84570') HTTP/1.1" 204 0
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7e660ccf4970c45e188fc2829925ea65.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341aa50>
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_1e1e45641810078ec21a7946e761ae0e.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1e1e45641810078ec21a7946e761ae0e.jpg saved to cache
2026-01-28 17:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62987550>
2026-01-28 17:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg saved to cache
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c2450>
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_81c88cf09cd63823e458f48b4286ebcd.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_81c88cf09cd63823e458f48b4286ebcd.jpg saved to cache
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_241a02701b488b023396374de1f5675c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d66fd667498a7e2e86e4405f669077cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_441f527367318b8c04a1f46ccb90225d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d83842b3c665d8a8289112fc17a0f500.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a92250>
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg saved to cache
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633e6e50>
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_7e660ccf4970c45e188fc2829925ea65.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7e660ccf4970c45e188fc2829925ea65.jpg saved to cache
2026-01-28 17:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RV71834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62961810>
2026-01-28 17:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_241a02701b488b023396374de1f5675c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_241a02701b488b023396374de1f5675c.jpg saved to cache
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a5f90>
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_d66fd667498a7e2e86e4405f669077cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d66fd667498a7e2e86e4405f669077cc.jpg saved to cache
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629fa290>
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_441f527367318b8c04a1f46ccb90225d.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_441f527367318b8c04a1f46ccb90225d.jpg saved to cache
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c1c10>
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg saved to cache
2026-01-28 17:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289e810>
2026-01-28 17:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_d83842b3c665d8a8289112fc17a0f500.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d83842b3c665d8a8289112fc17a0f500.jpg saved to cache
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_56d832c2b8d510a028c3e1a477796917.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA81893/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR29926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV54140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UK62633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP64898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD08126/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62881810>
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_56d832c2b8d510a028c3e1a477796917.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_56d832c2b8d510a028c3e1a477796917.jpg saved to cache
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62919d90>
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg saved to cache
2026-01-28 17:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63336890>
2026-01-28 17:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0d%252F0b%252F0d0bdf9fcbc989819cd1756045ce125a%252Fpa%252FSH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg saved to cache
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01
2026-01-28 17:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f1baa01-0f97-53dc-b808-762fb3ec4e01, skipping ID generation
2026-01-28 17:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with scrape type 1
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 from tracking dictionaries
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f1baa01-0f97-53dc-b808-762fb3ec4e01 sending to next pipeline
2026-01-28 17:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f1baa01-0f97-53dc-b808-762fb3ec4e01, identifier: SH03418
2026-01-28 17:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-01-28 17:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418
2026-01-28 17:07:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7f1baa01-0f97-53dc-b808-762fb3ec4e01 with identifier: SH03418 to the API
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:25:04Z',
 'fuel_type': 'hybrid',
 'id': '7f1baa01-0f97-53dc-b808-762fb3ec4e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH03418',
 'listing': 'auction',
 'location': 'ES, Trasona',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 28300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_4fc0769ee5cfe87dfb7631d05272eabc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_335b2f97e33f6f7cee08ceef5dd4a7b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1f52c58044fe9faa58b7f58aaf106d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_56d832c2b8d510a028c3e1a477796917.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_441f527367318b8c04a1f46ccb90225d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7503d6bcce27ebd3dc414dd4f4833900.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_241a02701b488b023396374de1f5675c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d83842b3c665d8a8289112fc17a0f500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_d66fd667498a7e2e86e4405f669077cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_7e660ccf4970c45e188fc2829925ea65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_71fe7b4b594c1d1a97e43f516f356ccb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_81c88cf09cd63823e458f48b4286ebcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_ce38d9e79c99be52dfa7c9aec91ae118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_1e1e45641810078ec21a7946e761ae0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_c436da7c129fb530f504441f66cb98c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f1baa01-0f97-53dc-b808-762fb3ec4e01/7f1baa01-0f97-53dc-b808-762fb3ec4e01_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0d/0b/0d0bdf9fcbc989819cd1756045ce125a/pa/SH03418_2910170de9ef148bf9f4817b4f9f27dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
 'transmission': 'automatic',
 'trim': '2WD Active Tech',
 'year': 2023}
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SH03418%27 HTTP/1.1" 200 None
2026-01-28 17:07:13 [auto1.es] INFO: Saving data for SH03418: {'created_time': 1769620033.782937, 'last_price_update_time': 1769620033.782948, 'auction_closing_time': 1769703904.0}
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SH03418') HTTP/1.1" 204 0
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT60667/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR83507> (referer: https://www.auto1.com/v1/car-details-view/BR83507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH10774> (referer: https://www.auto1.com/v1/car-details-view/PH10774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN12809> (referer: https://www.auto1.com/v1/car-details-view/TN12809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU81680> (referer: https://www.auto1.com/v1/car-details-view/YU81680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN08984> (referer: https://www.auto1.com/v1/car-details-view/AN08984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa440325-6b3e-5dec-8f91-a235e6edcc21 with identifier: BR83507
2026-01-28 17:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa440325-6b3e-5dec-8f91-a235e6edcc21 with scrape type 1
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fa440325-6b3e-5dec-8f91-a235e6edcc21
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_3711f9aed1d226b0a28478b071063aa3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_3711f9aed1d226b0a28478b071063aa3.jpg already downloaded
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_b7fed3634dd51eb2f9f731a0c29f3c3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b7fed3634dd51eb2f9f731a0c29f3c3c.jpg already downloaded
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_6abbce408d6a7f3a2493ecc70de16f50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6abbce408d6a7f3a2493ecc70de16f50.jpg already downloaded
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_41a431ae082071314039682a537283ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41a431ae082071314039682a537283ec.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_149eb4e877ff5bc8b60d684f00b7c564.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_149eb4e877ff5bc8b60d684f00b7c564.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_0cf19aef2edbd9f9fca5d9d4c0aa78c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_0cf19aef2edbd9f9fca5d9d4c0aa78c7.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_41e2e0b0b4f13a624d171d1f78a55e22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41e2e0b0b4f13a624d171d1f78a55e22.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_fa77a569e8cfaa0771d2fec64900207a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_fa77a569e8cfaa0771d2fec64900207a.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_cc1a444b65cac0823b6658503c81ef6b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cc1a444b65cac0823b6658503c81ef6b.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_405c22d59b40b499c1b79fd7785ac1aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_405c22d59b40b499c1b79fd7785ac1aa.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_b9e55164574308e951f2e775f0bcd2a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b9e55164574308e951f2e775f0bcd2a9.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_4ae6938de9ee667be77cde09dadb0fab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_4ae6938de9ee667be77cde09dadb0fab.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_6b6d56393f70a91f0b99dcb0839ec5b8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6b6d56393f70a91f0b99dcb0839ec5b8.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_cddea28989b4514e677ad039340f13eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cddea28989b4514e677ad039340f13eb.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_c7010842dc2b24f7b6c33a26ad978ed4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_c7010842dc2b24f7b6c33a26ad978ed4.jpg already downloaded
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F74%252Fde74749afa305db532ffcbc587f8094b%252Fpa%252FBR83507_b37bb28e15110ec4f525f6f95f9de8f8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b37bb28e15110ec4f525f6f95f9de8f8.jpg already downloaded
2026-01-28 17:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fa440325-6b3e-5dec-8f91-a235e6edcc21, identifier: BR83507
2026-01-28 17:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-01-28 17:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d755a4e7-d945-558b-87fa-d0e3e37edb04 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d755a4e7-d945-558b-87fa-d0e3e37edb04 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d755a4e7-d945-558b-87fa-d0e3e37edb04, identifier: PH10774
2026-01-28 17:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2026-01-28 17:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d8f779-bf4a-5575-8363-683f8344c053 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d8f779-bf4a-5575-8363-683f8344c053 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b2d8f779-bf4a-5575-8363-683f8344c053, identifier: TN12809
2026-01-28 17:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1311552c-1306-55c2-9894-d094e7b4aacd with identifier: YU81680
2026-01-28 17:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1311552c-1306-55c2-9894-d094e7b4aacd with scrape type 1
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg not downloaded yet
2026-01-28 17:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a642c6ca-203f-51b3-93a8-2fb84cd886d0 with identifier: AN08984
2026-01-28 17:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a642c6ca-203f-51b3-93a8-2fb84cd886d0 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a642c6ca-203f-51b3-93a8-2fb84cd886d0 with scrape type 2
2026-01-28 17:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a642c6ca-203f-51b3-93a8-2fb84cd886d0, identifier: AN08984
2026-01-28 17:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fa440325-6b3e-5dec-8f91-a235e6edcc21 with identifier: BR83507
2026-01-28 17:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fa440325-6b3e-5dec-8f91-a235e6edcc21 with identifier: BR83507
2026-01-28 17:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fa440325-6b3e-5dec-8f91-a235e6edcc21 with identifier: BR83507 to the API
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BR83507>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:23:00Z',
 'fuel_type': 'petrol',
 'id': 'fa440325-6b3e-5dec-8f91-a235e6edcc21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR83507',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 67952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_3711f9aed1d226b0a28478b071063aa3.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b7fed3634dd51eb2f9f731a0c29f3c3c.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6abbce408d6a7f3a2493ecc70de16f50.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41a431ae082071314039682a537283ec.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_149eb4e877ff5bc8b60d684f00b7c564.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_0cf19aef2edbd9f9fca5d9d4c0aa78c7.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41e2e0b0b4f13a624d171d1f78a55e22.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_fa77a569e8cfaa0771d2fec64900207a.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cc1a444b65cac0823b6658503c81ef6b.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_405c22d59b40b499c1b79fd7785ac1aa.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b9e55164574308e951f2e775f0bcd2a9.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_4ae6938de9ee667be77cde09dadb0fab.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6b6d56393f70a91f0b99dcb0839ec5b8.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cddea28989b4514e677ad039340f13eb.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_c7010842dc2b24f7b6c33a26ad978ed4.jpg',
                'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b37bb28e15110ec4f525f6f95f9de8f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_3711f9aed1d226b0a28478b071063aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b7fed3634dd51eb2f9f731a0c29f3c3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6abbce408d6a7f3a2493ecc70de16f50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41a431ae082071314039682a537283ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_149eb4e877ff5bc8b60d684f00b7c564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_0cf19aef2edbd9f9fca5d9d4c0aa78c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_41e2e0b0b4f13a624d171d1f78a55e22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_fa77a569e8cfaa0771d2fec64900207a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cc1a444b65cac0823b6658503c81ef6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80805,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_405c22d59b40b499c1b79fd7785ac1aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b9e55164574308e951f2e775f0bcd2a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_4ae6938de9ee667be77cde09dadb0fab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_6b6d56393f70a91f0b99dcb0839ec5b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_cddea28989b4514e677ad039340f13eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_c7010842dc2b24f7b6c33a26ad978ed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa440325-6b3e-5dec-8f91-a235e6edcc21/fa440325-6b3e-5dec-8f91-a235e6edcc21_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118050,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/74/de74749afa305db532ffcbc587f8094b/pa/BR83507_b37bb28e15110ec4f525f6f95f9de8f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR83507%27 HTTP/1.1" 200 None
2026-01-28 17:07:14 [auto1.es] INFO: Saving data for BR83507: {'created_time': 1769620034.992268, 'last_price_update_time': 1769620034.99228, 'auction_closing_time': 1769703780.0}
2026-01-28 17:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR83507') HTTP/1.1" 204 0
2026-01-28 17:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-01-28 17:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774
2026-01-28 17:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d755a4e7-d945-558b-87fa-d0e3e37edb04 with identifier: PH10774 to the API
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PH10774>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:02:12Z',
 'fuel_type': 'petrol',
 'id': 'd755a4e7-d945-558b-87fa-d0e3e37edb04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH10774',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 16981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Klass 2WD',
 'transmission': 'manual',
 'trim': 'Klass 2WD',
 'year': 2023}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH10774%27 HTTP/1.1" 200 None
2026-01-28 17:07:15 [auto1.es] INFO: Saving data for PH10774: {'auction_closing_time': 1769702532.0, 'created_time': 1769003226.645159, 'last_price_update_time': 1769620035.291677}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH10774') HTTP/1.1" 204 0
2026-01-28 17:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2026-01-28 17:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809
2026-01-28 17:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b2d8f779-bf4a-5575-8363-683f8344c053 with identifier: TN12809 to the API
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TN12809>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:02:12Z',
 'fuel_type': 'petrol',
 'id': 'b2d8f779-bf4a-5575-8363-683f8344c053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN12809',
 'listing': 'auction',
 'location': 'ES, A Cañiza Pontevedra',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 76035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.6 TGDI Emotion',
 'transmission': 'manual',
 'trim': 'Emotion',
 'year': 2019}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TN12809%27 HTTP/1.1" 200 None
2026-01-28 17:07:15 [auto1.es] INFO: Saving data for TN12809: {'auction_closing_time': 1769702532.0, 'created_time': 1767780206.314456, 'last_price_update_time': 1769620035.671188}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TN12809') HTTP/1.1" 204 0
2026-01-28 17:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a642c6ca-203f-51b3-93a8-2fb84cd886d0 with identifier: AN08984
2026-01-28 17:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a642c6ca-203f-51b3-93a8-2fb84cd886d0 with identifier: AN08984
2026-01-28 17:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167723 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167723
2026-01-28 17:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a642c6ca-203f-51b3-93a8-2fb84cd886d0 spider: auto1.es
2026-01-28 17:07:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a642c6ca-203f-51b3-93a8-2fb84cd886d0 due to rule: high_mileage_for_country.json, error: 167723 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167723
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:25:46Z',
 'fuel_type': 'diesel',
 'id': 'a642c6ca-203f-51b3-93a8-2fb84cd886d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN08984',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 167723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AN08984%27 HTTP/1.1" 200 None
2026-01-28 17:07:15 [auto1.es] INFO: Saving data for AN08984: {'auction_closing_time': 1769703946.0, 'created_time': 1769003502.997403, 'last_price_update_time': 1769620035.906343}
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AN08984') HTTP/1.1" 204 0
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_250b3399e68dd9ccf3b7793290a6a255.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_250b3399e68dd9ccf3b7793290a6a255.jpg not downloaded yet
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg not downloaded yet
2026-01-28 17:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES82633> (referer: https://www.auto1.com/v1/car-details-view/ES82633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND84609> (referer: https://www.auto1.com/v1/car-details-view/ND84609/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_d6a5deeae36c57933e9a58f63e0572de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_d6a5deeae36c57933e9a58f63e0572de.jpg not downloaded yet
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_858ad16708ac02a5c235b9b08dc9df21.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_858ad16708ac02a5c235b9b08dc9df21.jpg not downloaded yet
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_460fed03b83b4558ed4dde13626cb7bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_460fed03b83b4558ed4dde13626cb7bd.jpg not downloaded yet
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg not downloaded yet
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_74228a5d2c754066c9b555203df9fba8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_74228a5d2c754066c9b555203df9fba8.jpg not downloaded yet
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_476a13603cac22aa0a9ccedc12747648.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_476a13603cac22aa0a9ccedc12747648.jpg not downloaded yet
2026-01-28 17:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-01-28 17:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c632c815-29b3-5cc1-b847-9b16a709c21f with scrape type 2
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c632c815-29b3-5cc1-b847-9b16a709c21f with scrape type 2
2026-01-28 17:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c632c815-29b3-5cc1-b847-9b16a709c21f, identifier: ES82633
2026-01-28 17:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93534eab-fd40-5a24-8b65-44ab418a4c66 with identifier: ND84609
2026-01-28 17:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93534eab-fd40-5a24-8b65-44ab418a4c66 with scrape type 2
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93534eab-fd40-5a24-8b65-44ab418a4c66 with scrape type 2
2026-01-28 17:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 93534eab-fd40-5a24-8b65-44ab418a4c66, identifier: ND84609
2026-01-28 17:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_4c1901c9426dbcd35198f43551c9dde2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_4c1901c9426dbcd35198f43551c9dde2.jpg not downloaded yet
2026-01-28 17:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-01-28 17:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633
2026-01-28 17:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: c632c815-29b3-5cc1-b847-9b16a709c21f with identifier: ES82633 to the API
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ES82633>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:22:48Z',
 'fuel_type': 'diesel',
 'id': 'c632c815-29b3-5cc1-b847-9b16a709c21f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES82633',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 119248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ES82633%27 HTTP/1.1" 200 None
2026-01-28 17:07:16 [auto1.es] INFO: Saving data for ES82633: {'auction_closing_time': 1769703768.0, 'created_time': 1769101334.282202, 'last_price_update_time': 1769620036.667874}
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ES82633') HTTP/1.1" 204 0
2026-01-28 17:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 93534eab-fd40-5a24-8b65-44ab418a4c66 with identifier: ND84609
2026-01-28 17:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 93534eab-fd40-5a24-8b65-44ab418a4c66 with identifier: ND84609
2026-01-28 17:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 93534eab-fd40-5a24-8b65-44ab418a4c66 with identifier: ND84609 to the API
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%2793534eab-fd40-5a24-8b65-44ab418a4c66%27 HTTP/1.1" 200 None
2026-01-28 17:07:17 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 93534eab-fd40-5a24-8b65-44ab418a4c66: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:07:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ND84609>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:43:46Z',
 'fuel_type': 'petrol',
 'id': '93534eab-fd40-5a24-8b65-44ab418a4c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND84609',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 59996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Subaru XV 2.0 Mild-Hybrid Executive Plus',
 'transmission': 'automatic',
 'trim': 'Executive Plus',
 'year': 2023}
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND84609%27 HTTP/1.1" 200 None
2026-01-28 17:07:17 [auto1.es] INFO: Saving data for ND84609: {'auction_closing_time': 1769705026.0, 'created_time': 1764223311.705531, 'last_price_update_time': 1769620037.307547}
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ND84609') HTTP/1.1" 204 0
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_250b3399e68dd9ccf3b7793290a6a255.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg not downloaded yet
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF45409> (referer: https://www.auto1.com/v1/car-details-view/NF45409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL95090> (referer: https://www.auto1.com/v1/car-details-view/BL95090/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR17798/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN50898> (referer: https://www.auto1.com/v1/car-details-view/KN50898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635bbcd0>
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg saved to cache
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_9d430de08887f9579f41bdcd5155d65f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_9d430de08887f9579f41bdcd5155d65f.jpg not downloaded yet
2026-01-28 17:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_476a13603cac22aa0a9ccedc12747648.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_6243a12fe68895dcf61a68d328976c1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6243a12fe68895dcf61a68d328976c1c.jpg not downloaded yet
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293ecd0>
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_250b3399e68dd9ccf3b7793290a6a255.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_250b3399e68dd9ccf3b7793290a6a255.jpg saved to cache
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7ad6e4-8bab-54fc-a034-a7b33f870eea with identifier: NF45409
2026-01-28 17:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7ad6e4-8bab-54fc-a034-a7b33f870eea with scrape type 2
2026-01-28 17:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7ad6e4-8bab-54fc-a034-a7b33f870eea with scrape type 2
2026-01-28 17:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cd7ad6e4-8bab-54fc-a034-a7b33f870eea, identifier: NF45409
2026-01-28 17:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad7ec99f-d370-59e2-9285-ed09973837b3 with identifier: BL95090
2026-01-28 17:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad7ec99f-d370-59e2-9285-ed09973837b3 with scrape type 1
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ad7ec99f-d370-59e2-9285-ed09973837b3
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_252781077db27792233475e7923a1e9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_252781077db27792233475e7923a1e9b.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_5a83a51144ac67ba08b6eee5326a7b5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_5a83a51144ac67ba08b6eee5326a7b5e.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_6b3e6a28b846c60156969908d1febf54.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_6b3e6a28b846c60156969908d1febf54.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_b99726802e0ebe0bf7b63acba787c748.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b99726802e0ebe0bf7b63acba787c748.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_b555fe94134e10698bb6d07648989ede.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b555fe94134e10698bb6d07648989ede.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_09f1dcce9fe4e2a0c3af8e479388ea26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_09f1dcce9fe4e2a0c3af8e479388ea26.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_2a245e7c668146f055e58b969409fc56.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2a245e7c668146f055e58b969409fc56.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_dd1c7ad82985c352a29db2da5f76c3d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dd1c7ad82985c352a29db2da5f76c3d5.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_c0a88dcdd2306352a15bf96c82064d26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_c0a88dcdd2306352a15bf96c82064d26.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_dccd42bec5b985619edf336686d03539.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dccd42bec5b985619edf336686d03539.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_a5cf8a0b3359cf29ca054fdf6f298860.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_a5cf8a0b3359cf29ca054fdf6f298860.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_3e09c44e05a9634dad8ac70c4e5c365a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_3e09c44e05a9634dad8ac70c4e5c365a.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_671072e0a7d255cd85117f50ef8079ad.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_671072e0a7d255cd85117f50ef8079ad.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_2e9ba78c98f683b8a183a81f29d6b3ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2e9ba78c98f683b8a183a81f29d6b3ac.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_64b81f4afaa2b208a759f08bf874b6c2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_64b81f4afaa2b208a759f08bf874b6c2.jpg already downloaded
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Fd6%252Fedd6a8b0d6e2b2941ac6dbe3408b566f%252Fpa%252FBL95090_dc6ea0bb5ed90f4cc366994c97de5787.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dc6ea0bb5ed90f4cc366994c97de5787.jpg already downloaded
2026-01-28 17:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad7ec99f-d370-59e2-9285-ed09973837b3, identifier: BL95090
2026-01-28 17:07:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2026-01-28 17:07:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a406fa-3529-5281-ab3d-c0496f1240c4 with scrape type 2
2026-01-28 17:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95a406fa-3529-5281-ab3d-c0496f1240c4 with scrape type 2
2026-01-28 17:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 95a406fa-3529-5281-ab3d-c0496f1240c4, identifier: KN50898
2026-01-28 17:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cd7ad6e4-8bab-54fc-a034-a7b33f870eea with identifier: NF45409
2026-01-28 17:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cd7ad6e4-8bab-54fc-a034-a7b33f870eea with identifier: NF45409
2026-01-28 17:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: cd7ad6e4-8bab-54fc-a034-a7b33f870eea with identifier: NF45409 to the API
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF45409>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-01-29T16:34:25Z',
 'fuel_type': 'petrol',
 'id': 'cd7ad6e4-8bab-54fc-a034-a7b33f870eea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF45409',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 115134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2020}
2026-01-28 17:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF45409%27 HTTP/1.1" 200 None
2026-01-28 17:07:19 [auto1.es] INFO: Saving data for NF45409: {'auction_closing_time': 1769704465.0, 'created_time': 1769148202.800188, 'last_price_update_time': 1769620039.008076}
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF45409') HTTP/1.1" 204 0
2026-01-28 17:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad7ec99f-d370-59e2-9285-ed09973837b3 with identifier: BL95090
2026-01-28 17:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad7ec99f-d370-59e2-9285-ed09973837b3 with identifier: BL95090
2026-01-28 17:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157986 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157986
2026-01-28 17:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ad7ec99f-d370-59e2-9285-ed09973837b3 spider: auto1.es
2026-01-28 17:07:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ad7ec99f-d370-59e2-9285-ed09973837b3 due to rule: high_mileage_for_country.json, error: 157986 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157986
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:06:36Z',
 'fuel_type': 'petrol',
 'id': 'ad7ec99f-d370-59e2-9285-ed09973837b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL95090',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 157986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_252781077db27792233475e7923a1e9b.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_5a83a51144ac67ba08b6eee5326a7b5e.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_6b3e6a28b846c60156969908d1febf54.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b99726802e0ebe0bf7b63acba787c748.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b555fe94134e10698bb6d07648989ede.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_09f1dcce9fe4e2a0c3af8e479388ea26.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2a245e7c668146f055e58b969409fc56.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dd1c7ad82985c352a29db2da5f76c3d5.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_c0a88dcdd2306352a15bf96c82064d26.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dccd42bec5b985619edf336686d03539.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_a5cf8a0b3359cf29ca054fdf6f298860.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_3e09c44e05a9634dad8ac70c4e5c365a.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_671072e0a7d255cd85117f50ef8079ad.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2e9ba78c98f683b8a183a81f29d6b3ac.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_64b81f4afaa2b208a759f08bf874b6c2.jpg',
                'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dc6ea0bb5ed90f4cc366994c97de5787.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_252781077db27792233475e7923a1e9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_5a83a51144ac67ba08b6eee5326a7b5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_6b3e6a28b846c60156969908d1febf54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b99726802e0ebe0bf7b63acba787c748.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_b555fe94134e10698bb6d07648989ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_09f1dcce9fe4e2a0c3af8e479388ea26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2a245e7c668146f055e58b969409fc56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dd1c7ad82985c352a29db2da5f76c3d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_c0a88dcdd2306352a15bf96c82064d26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dccd42bec5b985619edf336686d03539.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_a5cf8a0b3359cf29ca054fdf6f298860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_3e09c44e05a9634dad8ac70c4e5c365a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_671072e0a7d255cd85117f50ef8079ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_2e9ba78c98f683b8a183a81f29d6b3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_64b81f4afaa2b208a759f08bf874b6c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad7ec99f-d370-59e2-9285-ed09973837b3/ad7ec99f-d370-59e2-9285-ed09973837b3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imged/d6/edd6a8b0d6e2b2941ac6dbe3408b566f/pa/BL95090_dc6ea0bb5ed90f4cc366994c97de5787.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet TURBO S 4x4',
 'transmission': 'automatic',
 'trim': 'TURBO S 4x4',
 'year': 2017}
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BL95090%27 HTTP/1.1" 200 None
2026-01-28 17:07:19 [auto1.es] INFO: Saving data for BL95090: {'created_time': 1769620039.376569, 'last_price_update_time': 1769620039.37658, 'auction_closing_time': 1769702796.0}
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BL95090') HTTP/1.1" 204 0
2026-01-28 17:07:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2026-01-28 17:07:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898
2026-01-28 17:07:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 95a406fa-3529-5281-ab3d-c0496f1240c4 with identifier: KN50898 to the API
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN50898>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:31:20Z',
 'fuel_type': 'diesel',
 'id': '95a406fa-3529-5281-ab3d-c0496f1240c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN50898',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 42409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN50898%27 HTTP/1.1" 200 None
2026-01-28 17:07:19 [auto1.es] INFO: Saving data for KN50898: {'auction_closing_time': 1769704280.0, 'created_time': 1768825946.635996, 'last_price_update_time': 1769620039.726651}
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN50898') HTTP/1.1" 204 0
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_74228a5d2c754066c9b555203df9fba8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_858ad16708ac02a5c235b9b08dc9df21.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg not downloaded yet
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_4c1901c9426dbcd35198f43551c9dde2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM65148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RV71834> (referer: https://www.auto1.com/v1/car-details-view/RV71834/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ71471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a56810>
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_476a13603cac22aa0a9ccedc12747648.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_476a13603cac22aa0a9ccedc12747648.jpg saved to cache
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_6e9c29cb793247f25b47b710e569561d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6e9c29cb793247f25b47b710e569561d.jpg not downloaded yet
2026-01-28 17:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SM82482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_9d430de08887f9579f41bdcd5155d65f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_7df820129eaf3a58ee5aa596a4c67201.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_7df820129eaf3a58ee5aa596a4c67201.jpg not downloaded yet
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635fb590>
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg saved to cache
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63425150>
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_74228a5d2c754066c9b555203df9fba8.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_74228a5d2c754066c9b555203df9fba8.jpg saved to cache
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ce9d0>
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_858ad16708ac02a5c235b9b08dc9df21.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_858ad16708ac02a5c235b9b08dc9df21.jpg saved to cache
2026-01-28 17:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63488650>
2026-01-28 17:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_4c1901c9426dbcd35198f43551c9dde2.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_4c1901c9426dbcd35198f43551c9dde2.jpg saved to cache
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdc2450e-32ee-5197-b769-73feb253c9ce with identifier: RV71834
2026-01-28 17:07:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdc2450e-32ee-5197-b769-73feb253c9ce with scrape type 1
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fdc2450e-32ee-5197-b769-73feb253c9ce
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_612a9271c707ce47238a985e527f6ef7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_612a9271c707ce47238a985e527f6ef7.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_ebdd75f7ba529745e5621ff4a4f1cd6d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_ebdd75f7ba529745e5621ff4a4f1cd6d.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_618afd43bed90e6a13148e4d7824548c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_618afd43bed90e6a13148e4d7824548c.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_e39b582eace32d68cbb10b7bd326cbf4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_e39b582eace32d68cbb10b7bd326cbf4.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_9444dfd6ade9412a82c3470df32d31c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9444dfd6ade9412a82c3470df32d31c8.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_0b90c3b314ba9dd3f457ec7444d33b0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_0b90c3b314ba9dd3f457ec7444d33b0d.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_3f09b70b6b9f7e9d0fadec7da66ed899.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_3f09b70b6b9f7e9d0fadec7da66ed899.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_cad06c1530ac0f23dcdae73525eccc07.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_cad06c1530ac0f23dcdae73525eccc07.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_2e4c02bc0bca49947272c0ba126e8d25.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_2e4c02bc0bca49947272c0ba126e8d25.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_bc93b9c4ed4896cc8165907c8f8ac6cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_bc93b9c4ed4896cc8165907c8f8ac6cc.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_10b7376321cbf214c59d98872f7c54cd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_10b7376321cbf214c59d98872f7c54cd.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_12e6e41b7849929735574804a0212c7e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_12e6e41b7849929735574804a0212c7e.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_9b0a92e2ceb12da964349d1bf6f43d3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9b0a92e2ceb12da964349d1bf6f43d3a.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_fd0727c08b7cd85508e4d5d70fb46687.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_fd0727c08b7cd85508e4d5d70fb46687.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_992676ca6e263e461e076a337b7c3117.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_992676ca6e263e461e076a337b7c3117.jpg already downloaded
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F03%252F0a03dcc558e1cbe428cc9228569dc73e%252Fpa%252FRV71834_40f3979d19e6b860480dc2491dd5bc41.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_40f3979d19e6b860480dc2491dd5bc41.jpg already downloaded
2026-01-28 17:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fdc2450e-32ee-5197-b769-73feb253c9ce, identifier: RV71834
2026-01-28 17:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fdc2450e-32ee-5197-b769-73feb253c9ce with identifier: RV71834
2026-01-28 17:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fdc2450e-32ee-5197-b769-73feb253c9ce with identifier: RV71834
2026-01-28 17:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fdc2450e-32ee-5197-b769-73feb253c9ce with identifier: RV71834 to the API
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RV71834>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:19:24Z',
 'fuel_type': 'petrol',
 'id': 'fdc2450e-32ee-5197-b769-73feb253c9ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV71834',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 17423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_612a9271c707ce47238a985e527f6ef7.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_ebdd75f7ba529745e5621ff4a4f1cd6d.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_618afd43bed90e6a13148e4d7824548c.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_e39b582eace32d68cbb10b7bd326cbf4.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9444dfd6ade9412a82c3470df32d31c8.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_0b90c3b314ba9dd3f457ec7444d33b0d.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_3f09b70b6b9f7e9d0fadec7da66ed899.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_cad06c1530ac0f23dcdae73525eccc07.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_2e4c02bc0bca49947272c0ba126e8d25.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_bc93b9c4ed4896cc8165907c8f8ac6cc.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_10b7376321cbf214c59d98872f7c54cd.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_12e6e41b7849929735574804a0212c7e.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9b0a92e2ceb12da964349d1bf6f43d3a.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_fd0727c08b7cd85508e4d5d70fb46687.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_992676ca6e263e461e076a337b7c3117.jpg',
                'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_40f3979d19e6b860480dc2491dd5bc41.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_612a9271c707ce47238a985e527f6ef7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_ebdd75f7ba529745e5621ff4a4f1cd6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_618afd43bed90e6a13148e4d7824548c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_e39b582eace32d68cbb10b7bd326cbf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9444dfd6ade9412a82c3470df32d31c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_0b90c3b314ba9dd3f457ec7444d33b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_3f09b70b6b9f7e9d0fadec7da66ed899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73416,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_cad06c1530ac0f23dcdae73525eccc07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_2e4c02bc0bca49947272c0ba126e8d25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_bc93b9c4ed4896cc8165907c8f8ac6cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_10b7376321cbf214c59d98872f7c54cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_12e6e41b7849929735574804a0212c7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53814,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_9b0a92e2ceb12da964349d1bf6f43d3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_fd0727c08b7cd85508e4d5d70fb46687.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_992676ca6e263e461e076a337b7c3117.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdc2450e-32ee-5197-b769-73feb253c9ce/fdc2450e-32ee-5197-b769-73feb253c9ce_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/03/0a03dcc558e1cbe428cc9228569dc73e/pa/RV71834_40f3979d19e6b860480dc2491dd5bc41.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2022}
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RV71834%27 HTTP/1.1" 200 None
2026-01-28 17:07:21 [auto1.es] INFO: Saving data for RV71834: {'created_time': 1769620041.765557, 'last_price_update_time': 1769620041.765567, 'auction_closing_time': 1769703564.0}
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RV71834') HTTP/1.1" 204 0
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6243a12fe68895dcf61a68d328976c1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_d6a5deeae36c57933e9a58f63e0572de.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV54140> (referer: https://www.auto1.com/v1/car-details-view/YV54140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UK62633> (referer: https://www.auto1.com/v1/car-details-view/UK62633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD08126> (referer: https://www.auto1.com/v1/car-details-view/XD08126/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62741490>
2026-01-28 17:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_9d430de08887f9579f41bdcd5155d65f.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_9d430de08887f9579f41bdcd5155d65f.jpg saved to cache
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6e9c29cb793247f25b47b710e569561d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6278e510>
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg saved to cache
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63426510>
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_6243a12fe68895dcf61a68d328976c1c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6243a12fe68895dcf61a68d328976c1c.jpg saved to cache
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aad850>
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_d6a5deeae36c57933e9a58f63e0572de.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_d6a5deeae36c57933e9a58f63e0572de.jpg saved to cache
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a93dd0>
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg saved to cache
2026-01-28 17:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a619d0>
2026-01-28 17:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg saved to cache
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with identifier: YV54140
2026-01-28 17:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with scrape type 1
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9397a2ed0aeede3f997cf231a7554a89.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9397a2ed0aeede3f997cf231a7554a89.jpg not downloaded yet
2026-01-28 17:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165685bf-8647-59ed-9a45-31c4b4b07918 with identifier: UK62633
2026-01-28 17:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 165685bf-8647-59ed-9a45-31c4b4b07918 with scrape type 1
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 165685bf-8647-59ed-9a45-31c4b4b07918
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_a051beec3915930ffa9cebc08abe70ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a051beec3915930ffa9cebc08abe70ab.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_eb8205412af9aeb9344c8e06a417fcc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_eb8205412af9aeb9344c8e06a417fcc0.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_c9d53d8d4866b8224b8bb5292917525a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_c9d53d8d4866b8224b8bb5292917525a.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_91b9015253180d6765ad1a383e3468c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_91b9015253180d6765ad1a383e3468c1.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_346cf57cba4af28be5da91173c384e8a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_346cf57cba4af28be5da91173c384e8a.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_bd0f1be66a459eeb5d77306a233dde3f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_bd0f1be66a459eeb5d77306a233dde3f.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_574aaac08bd94ebbc13276da864ec1c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_574aaac08bd94ebbc13276da864ec1c7.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_dc835b095f8893f28d1030105c7bcca8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_dc835b095f8893f28d1030105c7bcca8.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_d3d4a6a90d43de132d652bef637c7b31.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_d3d4a6a90d43de132d652bef637c7b31.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_65585550628b40f183f2fb8e05a0f0d7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_65585550628b40f183f2fb8e05a0f0d7.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_a795c71b2b9cf53ac2591a2983de8c89.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a795c71b2b9cf53ac2591a2983de8c89.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_198ebf6ec4018b962679e8bda37e22ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_198ebf6ec4018b962679e8bda37e22ac.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_897c3f53aefa7a9e88c8ffe4420779db.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_897c3f53aefa7a9e88c8ffe4420779db.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_fc83bdd0b8abafbda236c59c75de4d72.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_fc83bdd0b8abafbda236c59c75de4d72.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_9d2087d95f9841b1b8b91ec2babcfaf0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_9d2087d95f9841b1b8b91ec2babcfaf0.jpg already downloaded
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252F1b%252F4a1bf6c86c2c2df310a4967ce8e4e490%252Fpa%252FUK62633_96348f6bfcc39d1a2537c3020eca403f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_96348f6bfcc39d1a2537c3020eca403f.jpg already downloaded
2026-01-28 17:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 165685bf-8647-59ed-9a45-31c4b4b07918, identifier: UK62633
2026-01-28 17:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93105537-37a5-592a-9ea9-88898fcba973 with identifier: XD08126
2026-01-28 17:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93105537-37a5-592a-9ea9-88898fcba973 with scrape type 2
2026-01-28 17:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93105537-37a5-592a-9ea9-88898fcba973 with scrape type 2
2026-01-28 17:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 93105537-37a5-592a-9ea9-88898fcba973, identifier: XD08126
2026-01-28 17:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 165685bf-8647-59ed-9a45-31c4b4b07918 with identifier: UK62633
2026-01-28 17:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 165685bf-8647-59ed-9a45-31c4b4b07918 with identifier: UK62633
2026-01-28 17:07:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 165685bf-8647-59ed-9a45-31c4b4b07918 with identifier: UK62633 to the API
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UK62633>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-01-29T16:33:35Z',
 'fuel_type': 'diesel',
 'id': '165685bf-8647-59ed-9a45-31c4b4b07918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK62633',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 101224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a051beec3915930ffa9cebc08abe70ab.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_eb8205412af9aeb9344c8e06a417fcc0.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_c9d53d8d4866b8224b8bb5292917525a.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_91b9015253180d6765ad1a383e3468c1.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_346cf57cba4af28be5da91173c384e8a.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_bd0f1be66a459eeb5d77306a233dde3f.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_574aaac08bd94ebbc13276da864ec1c7.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_dc835b095f8893f28d1030105c7bcca8.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_d3d4a6a90d43de132d652bef637c7b31.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_65585550628b40f183f2fb8e05a0f0d7.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a795c71b2b9cf53ac2591a2983de8c89.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_198ebf6ec4018b962679e8bda37e22ac.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_897c3f53aefa7a9e88c8ffe4420779db.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_fc83bdd0b8abafbda236c59c75de4d72.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_9d2087d95f9841b1b8b91ec2babcfaf0.jpg',
                'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_96348f6bfcc39d1a2537c3020eca403f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a051beec3915930ffa9cebc08abe70ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_eb8205412af9aeb9344c8e06a417fcc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_c9d53d8d4866b8224b8bb5292917525a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_91b9015253180d6765ad1a383e3468c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_346cf57cba4af28be5da91173c384e8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_bd0f1be66a459eeb5d77306a233dde3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_574aaac08bd94ebbc13276da864ec1c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_dc835b095f8893f28d1030105c7bcca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_d3d4a6a90d43de132d652bef637c7b31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_65585550628b40f183f2fb8e05a0f0d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_a795c71b2b9cf53ac2591a2983de8c89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_198ebf6ec4018b962679e8bda37e22ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_897c3f53aefa7a9e88c8ffe4420779db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56553,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_fc83bdd0b8abafbda236c59c75de4d72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_9d2087d95f9841b1b8b91ec2babcfaf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165685bf-8647-59ed-9a45-31c4b4b07918/165685bf-8647-59ed-9a45-31c4b4b07918_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/1b/4a1bf6c86c2c2df310a4967ce8e4e490/pa/UK62633_96348f6bfcc39d1a2537c3020eca403f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Grandland X 2.0 CDTI Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2018}
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UK62633%27 HTTP/1.1" 200 None
2026-01-28 17:07:24 [auto1.es] INFO: Saving data for UK62633: {'created_time': 1769620044.079511, 'last_price_update_time': 1769620044.079522, 'auction_closing_time': 1769704415.0}
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UK62633') HTTP/1.1" 204 0
2026-01-28 17:07:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 93105537-37a5-592a-9ea9-88898fcba973 with identifier: XD08126
2026-01-28 17:07:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 93105537-37a5-592a-9ea9-88898fcba973 with identifier: XD08126
2026-01-28 17:07:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 93105537-37a5-592a-9ea9-88898fcba973 with identifier: XD08126 to the API
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD08126>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 213,
 'expiration_date': '2026-01-29T16:53:17Z',
 'fuel_type': 'hybrid',
 'id': '93105537-37a5-592a-9ea9-88898fcba973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD08126',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 25359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 VC-T e-POWER Tekna 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna 4x4',
 'year': 2024}
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD08126%27 HTTP/1.1" 200 None
2026-01-28 17:07:24 [auto1.es] INFO: Saving data for XD08126: {'auction_closing_time': 1769705597.0, 'created_time': 1767027844.044906, 'last_price_update_time': 1769620044.492958}
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XD08126') HTTP/1.1" 204 0
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_8f9c6475323f7358a5563573dd6f15ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_8f9c6475323f7358a5563573dd6f15ee.jpg not downloaded yet
2026-01-28 17:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_7df820129eaf3a58ee5aa596a4c67201.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP64898> (referer: https://www.auto1.com/v1/car-details-view/LP64898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_72d74d71ddef8ed84cf379bc79062801.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_72d74d71ddef8ed84cf379bc79062801.jpg not downloaded yet
2026-01-28 17:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260a410>
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_6e9c29cb793247f25b47b710e569561d.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6e9c29cb793247f25b47b710e569561d.jpg saved to cache
2026-01-28 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_99e5f5b589f26e619592fe2a16ce6334.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_99e5f5b589f26e619592fe2a16ce6334.jpg not downloaded yet
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62864d10>
2026-01-28 17:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_7df820129eaf3a58ee5aa596a4c67201.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_7df820129eaf3a58ee5aa596a4c67201.jpg saved to cache
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cffc482-0c92-5309-8c48-8d079afbfa3b with identifier: LP64898
2026-01-28 17:07:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cffc482-0c92-5309-8c48-8d079afbfa3b with scrape type 2
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cffc482-0c92-5309-8c48-8d079afbfa3b with scrape type 2
2026-01-28 17:07:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cffc482-0c92-5309-8c48-8d079afbfa3b, identifier: LP64898
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_42f7175d1c32aa154126f5d281a6611a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_42f7175d1c32aa154126f5d281a6611a.jpg not downloaded yet
2026-01-28 17:07:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cffc482-0c92-5309-8c48-8d079afbfa3b with identifier: LP64898
2026-01-28 17:07:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cffc482-0c92-5309-8c48-8d079afbfa3b with identifier: LP64898
2026-01-28 17:07:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cffc482-0c92-5309-8c48-8d079afbfa3b with identifier: LP64898 to the API
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LP64898>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:48:48Z',
 'fuel_type': 'petrol',
 'id': '3cffc482-0c92-5309-8c48-8d079afbfa3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP64898',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 54472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend+',
 'transmission': 'manual',
 'trim': 'Trend+',
 'year': 2019}
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LP64898%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [auto1.es] INFO: Saving data for LP64898: {'auction_closing_time': 1769705328.0, 'created_time': 1768825696.555778, 'last_price_update_time': 1769620045.566083}
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LP64898') HTTP/1.1" 204 0
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9397a2ed0aeede3f997cf231a7554a89.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_8f9c6475323f7358a5563573dd6f15ee.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg not downloaded yet
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM65148> (referer: https://www.auto1.com/v1/car-details-view/FM65148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GD68452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR29926> (referer: https://www.auto1.com/v1/car-details-view/VR29926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_7f4922841688de169a7c3a381beba592.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_7f4922841688de169a7c3a381beba592.jpg not downloaded yet
2026-01-28 17:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg not downloaded yet
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_e9f351e7135e38e57e22d8bd111d5885.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e9f351e7135e38e57e22d8bd111d5885.jpg not downloaded yet
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ71471> (referer: https://www.auto1.com/v1/car-details-view/NJ71471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg not downloaded yet
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT60667> (referer: https://www.auto1.com/v1/car-details-view/VT60667/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_99e5f5b589f26e619592fe2a16ce6334.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_72d74d71ddef8ed84cf379bc79062801.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_622a4e394d64404f1fd74783d29ea07a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_622a4e394d64404f1fd74783d29ea07a.jpg not downloaded yet
2026-01-28 17:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg not downloaded yet
2026-01-28 17:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR17798> (referer: https://www.auto1.com/v1/car-details-view/TR17798/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a49e50>
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9397a2ed0aeede3f997cf231a7554a89.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9397a2ed0aeede3f997cf231a7554a89.jpg saved to cache
2026-01-28 17:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6276c1d0>
2026-01-28 17:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_8f9c6475323f7358a5563573dd6f15ee.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_8f9c6475323f7358a5563573dd6f15ee.jpg saved to cache
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_11031da5fe297ce438d6ea73cd31d380.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_11031da5fe297ce438d6ea73cd31d380.jpg not downloaded yet
2026-01-28 17:07:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_7f4922841688de169a7c3a381beba592.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0434107-5d25-56da-bd34-9f4b6552b19f with identifier: FM65148
2026-01-28 17:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0434107-5d25-56da-bd34-9f4b6552b19f with scrape type 2
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0434107-5d25-56da-bd34-9f4b6552b19f with scrape type 2
2026-01-28 17:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f0434107-5d25-56da-bd34-9f4b6552b19f, identifier: FM65148
2026-01-28 17:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-01-28 17:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with scrape type 1
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_b227b40daaca832783f1d79f1111507d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_b227b40daaca832783f1d79f1111507d.jpg not downloaded yet
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e9f351e7135e38e57e22d8bd111d5885.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_42f7175d1c32aa154126f5d281a6611a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg not downloaded yet
2026-01-28 17:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f0434107-5d25-56da-bd34-9f4b6552b19f with identifier: FM65148
2026-01-28 17:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f0434107-5d25-56da-bd34-9f4b6552b19f with identifier: FM65148
2026-01-28 17:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f0434107-5d25-56da-bd34-9f4b6552b19f with identifier: FM65148 to the API
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FM65148>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:43:16Z',
 'fuel_type': 'hybrid',
 'id': 'f0434107-5d25-56da-bd34-9f4b6552b19f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM65148',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 39188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2023}
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM65148%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [auto1.es] INFO: Saving data for FM65148: {'auction_closing_time': 1769704996.0, 'created_time': 1769003144.584676, 'last_price_update_time': 1769620046.664833}
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FM65148') HTTP/1.1" 204 0
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_9900e66ad90082c4190bb677d173075a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_9900e66ad90082c4190bb677d173075a.jpg not downloaded yet
2026-01-28 17:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM90480/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a4c8836-4afe-57da-b207-c69eb620242a with identifier: NJ71471
2026-01-28 17:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a4c8836-4afe-57da-b207-c69eb620242a with scrape type 2
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a4c8836-4afe-57da-b207-c69eb620242a with scrape type 2
2026-01-28 17:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6a4c8836-4afe-57da-b207-c69eb620242a, identifier: NJ71471
2026-01-28 17:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with identifier: VT60667
2026-01-28 17:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with scrape type 1
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_6ae2c285f90902bda1bd4f6975223168.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_6ae2c285f90902bda1bd4f6975223168.jpg not downloaded yet
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b2050>
2026-01-28 17:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_99e5f5b589f26e619592fe2a16ce6334.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_99e5f5b589f26e619592fe2a16ce6334.jpg saved to cache
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62888650>
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_72d74d71ddef8ed84cf379bc79062801.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_72d74d71ddef8ed84cf379bc79062801.jpg saved to cache
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcef38ae-6920-5a86-9470-5b8cddee1e37 with identifier: TR17798
2026-01-28 17:07:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcef38ae-6920-5a86-9470-5b8cddee1e37 with scrape type 2
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcef38ae-6920-5a86-9470-5b8cddee1e37 with scrape type 2
2026-01-28 17:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dcef38ae-6920-5a86-9470-5b8cddee1e37, identifier: TR17798
2026-01-28 17:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_460fed03b83b4558ed4dde13626cb7bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_024125ae68dcd7a543bce3e1718e14cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_024125ae68dcd7a543bce3e1718e14cb.jpg not downloaded yet
2026-01-28 17:07:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6a4c8836-4afe-57da-b207-c69eb620242a with identifier: NJ71471
2026-01-28 17:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6a4c8836-4afe-57da-b207-c69eb620242a with identifier: NJ71471
2026-01-28 17:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6a4c8836-4afe-57da-b207-c69eb620242a with identifier: NJ71471 to the API
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NJ71471>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:37:01Z',
 'fuel_type': 'diesel',
 'id': '6a4c8836-4afe-57da-b207-c69eb620242a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ71471',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 101899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NJ71471%27 HTTP/1.1" 200 None
2026-01-28 17:07:27 [auto1.es] INFO: Saving data for NJ71471: {'auction_closing_time': 1769704621.0, 'created_time': 1769003397.845926, 'last_price_update_time': 1769620047.883739}
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ71471') HTTP/1.1" 204 0
2026-01-28 17:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dcef38ae-6920-5a86-9470-5b8cddee1e37 with identifier: TR17798
2026-01-28 17:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dcef38ae-6920-5a86-9470-5b8cddee1e37 with identifier: TR17798
2026-01-28 17:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dcef38ae-6920-5a86-9470-5b8cddee1e37 with identifier: TR17798 to the API
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TR17798>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:55:53Z',
 'fuel_type': 'petrol',
 'id': 'dcef38ae-6920-5a86-9470-5b8cddee1e37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR17798',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 102426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X2 sDrive 18i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TR17798%27 HTTP/1.1" 200 None
2026-01-28 17:07:28 [auto1.es] INFO: Saving data for TR17798: {'auction_closing_time': 1769705753.0, 'created_time': 1768219771.382803, 'last_price_update_time': 1769620048.271015}
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TR17798') HTTP/1.1" 204 0
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628b6790>
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_7f4922841688de169a7c3a381beba592.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_7f4922841688de169a7c3a381beba592.jpg saved to cache
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f0550>
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg saved to cache
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626bf310>
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg saved to cache
2026-01-28 17:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626d27d0>
2026-01-28 17:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg saved to cache
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_622a4e394d64404f1fd74783d29ea07a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg not downloaded yet
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_e4b57731285070349d46a01326492553.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e4b57731285070349d46a01326492553.jpg not downloaded yet
2026-01-28 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA81893> (referer: https://www.auto1.com/v1/car-details-view/LA81893/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633e5450>
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_e9f351e7135e38e57e22d8bd111d5885.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e9f351e7135e38e57e22d8bd111d5885.jpg saved to cache
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62666bd0>
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_42f7175d1c32aa154126f5d281a6611a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_42f7175d1c32aa154126f5d281a6611a.jpg saved to cache
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_b1262077d569b55f43c2ec647756a946.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_b1262077d569b55f43c2ec647756a946.jpg not downloaded yet
2026-01-28 17:07:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_11031da5fe297ce438d6ea73cd31d380.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_94e59496e77591817cce7b58613a4150.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_94e59496e77591817cce7b58613a4150.jpg not downloaded yet
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg not downloaded yet
2026-01-28 17:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62653690>
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F7d%252F437d97bab92f9db251a279af2194bd00%252Fpa%252FYU81680_460fed03b83b4558ed4dde13626cb7bd.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_460fed03b83b4558ed4dde13626cb7bd.jpg saved to cache
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1311552c-1306-55c2-9894-d094e7b4aacd
2026-01-28 17:07:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1311552c-1306-55c2-9894-d094e7b4aacd, skipping ID generation
2026-01-28 17:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1311552c-1306-55c2-9894-d094e7b4aacd with scrape type 1
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1311552c-1306-55c2-9894-d094e7b4aacd from tracking dictionaries
2026-01-28 17:07:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1311552c-1306-55c2-9894-d094e7b4aacd sending to next pipeline
2026-01-28 17:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1311552c-1306-55c2-9894-d094e7b4aacd, identifier: YU81680
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_c35474996e4d8e56660ef11381137f0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_c35474996e4d8e56660ef11381137f0e.jpg not downloaded yet
2026-01-28 17:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1311552c-1306-55c2-9894-d094e7b4aacd with identifier: YU81680
2026-01-28 17:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1311552c-1306-55c2-9894-d094e7b4aacd with identifier: YU81680
2026-01-28 17:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1311552c-1306-55c2-9894-d094e7b4aacd with identifier: YU81680 to the API
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_460fed03b83b4558ed4dde13626cb7bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:26:55Z',
 'fuel_type': 'petrol',
 'id': '1311552c-1306-55c2-9894-d094e7b4aacd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU81680',
 'listing': 'auction',
 'location': 'ES, Girona',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 82892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_a730c5335ea984d5cfd84dcd7a1a2223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_250b3399e68dd9ccf3b7793290a6a255.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_ef94a82d90d99f3e5dfff1f5097f0c69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_d6a5deeae36c57933e9a58f63e0572de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_858ad16708ac02a5c235b9b08dc9df21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596609,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_460fed03b83b4558ed4dde13626cb7bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_1d724c3cdf1103fa222410c0ac70ef40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_74228a5d2c754066c9b555203df9fba8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_476a13603cac22aa0a9ccedc12747648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_4c1901c9426dbcd35198f43551c9dde2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_281dcc93d0ec737c213cbf34bc0b1883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_9d430de08887f9579f41bdcd5155d65f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6243a12fe68895dcf61a68d328976c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_3aef3f26eeb32ffaafd109dc39ab043c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_6e9c29cb793247f25b47b710e569561d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1311552c-1306-55c2-9894-d094e7b4aacd/1311552c-1306-55c2-9894-d094e7b4aacd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/7d/437d97bab92f9db251a279af2194bd00/pa/YU81680_7df820129eaf3a58ee5aa596a4c67201.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Tech",
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2021}
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU81680%27 HTTP/1.1" 200 None
2026-01-28 17:07:30 [auto1.es] INFO: Saving data for YU81680: {'created_time': 1769620050.466371, 'last_price_update_time': 1769620050.466384, 'auction_closing_time': 1769704015.0}
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU81680') HTTP/1.1" 204 0
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f52d0>
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg saved to cache
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291ca90>
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_622a4e394d64404f1fd74783d29ea07a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_622a4e394d64404f1fd74783d29ea07a.jpg saved to cache
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with identifier: LA81893
2026-01-28 17:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with scrape type 1
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 19 photos for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg not downloaded yet
2026-01-28 17:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg not downloaded yet
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_0373d2902439f646f17d72bdc9f4f50c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_0373d2902439f646f17d72bdc9f4f50c.jpg not downloaded yet
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_b227b40daaca832783f1d79f1111507d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_6ae2c285f90902bda1bd4f6975223168.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_9900e66ad90082c4190bb677d173075a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9247854f3819f4493bac19596b6a7148.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9247854f3819f4493bac19596b6a7148.jpg not downloaded yet
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_7678e01d6c0e5d5bef99b29311169083.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_7678e01d6c0e5d5bef99b29311169083.jpg not downloaded yet
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KL07706/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME28705/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW08330/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD57471/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f3450>
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_11031da5fe297ce438d6ea73cd31d380.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_11031da5fe297ce438d6ea73cd31d380.jpg saved to cache
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_024125ae68dcd7a543bce3e1718e14cb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_5da7be5cd5224caa775467af66f3b5cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5da7be5cd5224caa775467af66f3b5cf.jpg not downloaded yet
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_45033cbc195bf562d8434cef78ce6200.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_45033cbc195bf562d8434cef78ce6200.jpg not downloaded yet
2026-01-28 17:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg not downloaded yet
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg not downloaded yet
2026-01-28 17:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e4b57731285070349d46a01326492553.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_159da044dfb20670a36bb50ea0fc812b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_159da044dfb20670a36bb50ea0fc812b.jpg not downloaded yet
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg not downloaded yet
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63652890>
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg saved to cache
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f5d10>
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_b227b40daaca832783f1d79f1111507d.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_b227b40daaca832783f1d79f1111507d.jpg saved to cache
2026-01-28 17:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f7410>
2026-01-28 17:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_6ae2c285f90902bda1bd4f6975223168.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_6ae2c285f90902bda1bd4f6975223168.jpg saved to cache
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6280b5d0>
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_9900e66ad90082c4190bb677d173075a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_9900e66ad90082c4190bb677d173075a.jpg saved to cache
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_5d8c1b88a779d3c57807e41151963a50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5d8c1b88a779d3c57807e41151963a50.jpg not downloaded yet
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_c35474996e4d8e56660ef11381137f0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg not downloaded yet
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg not downloaded yet
2026-01-28 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627412d0>
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_024125ae68dcd7a543bce3e1718e14cb.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_024125ae68dcd7a543bce3e1718e14cb.jpg saved to cache
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_b1262077d569b55f43c2ec647756a946.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_94e59496e77591817cce7b58613a4150.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_0373d2902439f646f17d72bdc9f4f50c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_a847dacbf4e561a7f33daac89988c26a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_a847dacbf4e561a7f33daac89988c26a.jpg not downloaded yet
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PH24007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB08932/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL07014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SM82482> (referer: https://www.auto1.com/v1/car-details-view/SM82482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_99df3d568d8c354b02fea32027a80e71.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_99df3d568d8c354b02fea32027a80e71.jpg not downloaded yet
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg not downloaded yet
2026-01-28 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63640650>
2026-01-28 17:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_e4b57731285070349d46a01326492553.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e4b57731285070349d46a01326492553.jpg saved to cache
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg not downloaded yet
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629de210>
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg saved to cache
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628985d0>
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_16.jpg HTTP/1.1" 201 0
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_c35474996e4d8e56660ef11381137f0e.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_c35474996e4d8e56660ef11381137f0e.jpg saved to cache
2026-01-28 17:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344ffd0>
2026-01-28 17:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg saved to cache
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg not downloaded yet
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_087e13b0ac1bc71d48148f2c41478a48.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_087e13b0ac1bc71d48148f2c41478a48.jpg not downloaded yet
2026-01-28 17:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_45033cbc195bf562d8434cef78ce6200.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg not downloaded yet
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a056d0>
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_b1262077d569b55f43c2ec647756a946.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_b1262077d569b55f43c2ec647756a946.jpg saved to cache
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634d3dd0>
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_94e59496e77591817cce7b58613a4150.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_94e59496e77591817cce7b58613a4150.jpg saved to cache
2026-01-28 17:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627eb090>
2026-01-28 17:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_0373d2902439f646f17d72bdc9f4f50c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_0373d2902439f646f17d72bdc9f4f50c.jpg saved to cache
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6278db10>
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg saved to cache
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b62b6f28-9276-5607-ad05-232bf7dddb2b with identifier: SM82482
2026-01-28 17:07:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b62b6f28-9276-5607-ad05-232bf7dddb2b with scrape type 2
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b62b6f28-9276-5607-ad05-232bf7dddb2b with scrape type 2
2026-01-28 17:07:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b62b6f28-9276-5607-ad05-232bf7dddb2b, identifier: SM82482
2026-01-28 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_159da044dfb20670a36bb50ea0fc812b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5d8c1b88a779d3c57807e41151963a50.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg not downloaded yet
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg not downloaded yet
2026-01-28 17:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b62b6f28-9276-5607-ad05-232bf7dddb2b with identifier: SM82482
2026-01-28 17:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b62b6f28-9276-5607-ad05-232bf7dddb2b with identifier: SM82482
2026-01-28 17:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b62b6f28-9276-5607-ad05-232bf7dddb2b with identifier: SM82482 to the API
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SM82482>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:35:42Z',
 'fuel_type': 'gas',
 'id': 'b62b6f28-9276-5607-ad05-232bf7dddb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM82482',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 139546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 LPG Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2019}
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SM82482%27 HTTP/1.1" 200 None
2026-01-28 17:07:36 [auto1.es] INFO: Saving data for SM82482: {'auction_closing_time': 1769704542.0, 'created_time': 1767014751.6815, 'last_price_update_time': 1769620056.012647}
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SM82482') HTTP/1.1" 204 0
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg not downloaded yet
2026-01-28 17:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e67d0>
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg saved to cache
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_320e7828c30059ef514bbb05e0ebe822.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_320e7828c30059ef514bbb05e0ebe822.jpg not downloaded yet
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_df2a40004639e004e669c38e48d33bab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_df2a40004639e004e669c38e48d33bab.jpg not downloaded yet
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TB32811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM90480> (referer: https://www.auto1.com/v1/car-details-view/HM90480/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH18872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635bbe10>
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_45033cbc195bf562d8434cef78ce6200.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_45033cbc195bf562d8434cef78ce6200.jpg saved to cache
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_a847dacbf4e561a7f33daac89988c26a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg not downloaded yet
2026-01-28 17:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634ee710>
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_159da044dfb20670a36bb50ea0fc812b.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_159da044dfb20670a36bb50ea0fc812b.jpg saved to cache
2026-01-28 17:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633cf790>
2026-01-28 17:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg saved to cache
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6275ced0>
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_5d8c1b88a779d3c57807e41151963a50.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5d8c1b88a779d3c57807e41151963a50.jpg saved to cache
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_087e13b0ac1bc71d48148f2c41478a48.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_2cfc8a25557f3e41420046c590657b60.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_2cfc8a25557f3e41420046c590657b60.jpg not downloaded yet
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_253ab1a124f4f17179369dcbb67dd78b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_253ab1a124f4f17179369dcbb67dd78b.jpg not downloaded yet
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635410d0>
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_18.jpg HTTP/1.1" 201 0
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg saved to cache
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg not downloaded yet
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62864a50>
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg saved to cache
2026-01-28 17:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6287f050>
2026-01-28 17:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg saved to cache
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63374650>
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg saved to cache
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc with identifier: HM90480
2026-01-28 17:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc with scrape type 2
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc with scrape type 2
2026-01-28 17:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc, identifier: HM90480
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg not downloaded yet
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg not downloaded yet
2026-01-28 17:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc with identifier: HM90480
2026-01-28 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc with identifier: HM90480
2026-01-28 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165750 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165750
2026-01-28 17:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc spider: auto1.es
2026-01-28 17:07:38 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc due to rule: high_mileage_for_country.json, error: 165750 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165750
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:19:17Z',
 'fuel_type': 'diesel',
 'id': 'dec3beca-24f9-50f8-9bc4-5a2ac76a1cdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM90480',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 165750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HM90480%27 HTTP/1.1" 200 None
2026-01-28 17:07:38 [auto1.es] INFO: Saving data for HM90480: {'auction_closing_time': 1769703557.0, 'created_time': 1768401423.982806, 'last_price_update_time': 1769620058.767234}
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HM90480') HTTP/1.1" 204 0
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a63910>
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_a847dacbf4e561a7f33daac89988c26a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_a847dacbf4e561a7f33daac89988c26a.jpg saved to cache
2026-01-28 17:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_31df61c726c2a7fcdad7ab3481511303.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_31df61c726c2a7fcdad7ab3481511303.jpg not downloaded yet
2026-01-28 17:07:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62ae5ed0>
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_087e13b0ac1bc71d48148f2c41478a48.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_087e13b0ac1bc71d48148f2c41478a48.jpg saved to cache
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62755690>
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg saved to cache
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_df2a40004639e004e669c38e48d33bab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_99df3d568d8c354b02fea32027a80e71.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg not downloaded yet
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_506e592d1360a95607b067425053eaae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_506e592d1360a95607b067425053eaae.jpg not downloaded yet
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6334f390>
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg saved to cache
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629b1290>
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg saved to cache
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_320e7828c30059ef514bbb05e0ebe822.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_104def9eec7f11f3b149b70f9a1437e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_104def9eec7f11f3b149b70f9a1437e7.jpg not downloaded yet
2026-01-28 17:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_5f669c55b725f51cf44dccd102d22b01.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5f669c55b725f51cf44dccd102d22b01.jpg not downloaded yet
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg not downloaded yet
2026-01-28 17:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD57471> (referer: https://www.auto1.com/v1/car-details-view/SD57471/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63491cd0>
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg saved to cache
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62757d50>
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg saved to cache
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5da7be5cd5224caa775467af66f3b5cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg not downloaded yet
2026-01-28 17:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW08330> (referer: https://www.auto1.com/v1/car-details-view/EW08330/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL07014> (referer: https://www.auto1.com/v1/car-details-view/UL07014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KL07706> (referer: https://www.auto1.com/v1/car-details-view/KL07706/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635b98d0>
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_df2a40004639e004e669c38e48d33bab.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_df2a40004639e004e669c38e48d33bab.jpg saved to cache
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a61950>
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg saved to cache
2026-01-28 17:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629dcf50>
2026-01-28 17:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_99df3d568d8c354b02fea32027a80e71.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_99df3d568d8c354b02fea32027a80e71.jpg saved to cache
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5ce50>
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg saved to cache
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_253ab1a124f4f17179369dcbb67dd78b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_9a575812b67e61cfac55e9abfbecd609.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9a575812b67e61cfac55e9abfbecd609.jpg not downloaded yet
2026-01-28 17:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME28705> (referer: https://www.auto1.com/v1/car-details-view/ME28705/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627488d0>
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_320e7828c30059ef514bbb05e0ebe822.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_320e7828c30059ef514bbb05e0ebe822.jpg saved to cache
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62883750>
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg saved to cache
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201a3dae-ccec-591d-a653-a212ab0e73cc with identifier: SD57471
2026-01-28 17:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201a3dae-ccec-591d-a653-a212ab0e73cc with scrape type 2
2026-01-28 17:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201a3dae-ccec-591d-a653-a212ab0e73cc with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 201a3dae-ccec-591d-a653-a212ab0e73cc, identifier: SD57471
2026-01-28 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_31df61c726c2a7fcdad7ab3481511303.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB08932> (referer: https://www.auto1.com/v1/car-details-view/FB08932/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PH24007> (referer: https://www.auto1.com/v1/car-details-view/PH24007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 201a3dae-ccec-591d-a653-a212ab0e73cc with identifier: SD57471
2026-01-28 17:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 201a3dae-ccec-591d-a653-a212ab0e73cc with identifier: SD57471
2026-01-28 17:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 201a3dae-ccec-591d-a653-a212ab0e73cc with identifier: SD57471 to the API
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SD57471>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:54:19Z',
 'fuel_type': 'diesel',
 'id': '201a3dae-ccec-591d-a653-a212ab0e73cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD57471',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 48761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SD57471%27 HTTP/1.1" 200 None
2026-01-28 17:07:42 [auto1.es] INFO: Saving data for SD57471: {'auction_closing_time': 1769705659.0, 'created_time': 1767092052.656698, 'last_price_update_time': 1769620062.478129}
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SD57471') HTTP/1.1" 204 0
2026-01-28 17:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6299f4d0>
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_5da7be5cd5224caa775467af66f3b5cf.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5da7be5cd5224caa775467af66f3b5cf.jpg saved to cache
2026-01-28 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 625f57d2-0972-5551-9e9c-f1187122e830 with identifier: EW08330
2026-01-28 17:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 625f57d2-0972-5551-9e9c-f1187122e830 with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 625f57d2-0972-5551-9e9c-f1187122e830 with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 625f57d2-0972-5551-9e9c-f1187122e830, identifier: EW08330
2026-01-28 17:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with identifier: UL07014
2026-01-28 17:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 39d17a7d-9348-508a-9313-d1fe80b6dbb9, identifier: UL07014
2026-01-28 17:07:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-01-28 17:07:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe23f78e-e93e-5abd-acd9-b51972e14759 with scrape type 2
2026-01-28 17:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe23f78e-e93e-5abd-acd9-b51972e14759 with scrape type 2
2026-01-28 17:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fe23f78e-e93e-5abd-acd9-b51972e14759, identifier: KL07706
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_104def9eec7f11f3b149b70f9a1437e7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg not downloaded yet
2026-01-28 17:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 625f57d2-0972-5551-9e9c-f1187122e830 with identifier: EW08330
2026-01-28 17:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 625f57d2-0972-5551-9e9c-f1187122e830 with identifier: EW08330
2026-01-28 17:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 625f57d2-0972-5551-9e9c-f1187122e830 spider: auto1.es
2026-01-28 17:07:43 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 625f57d2-0972-5551-9e9c-f1187122e830 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:07:29Z',
 'fuel_type': 'diesel',
 'id': '625f57d2-0972-5551-9e9c-f1187122e830',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW08330',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 88350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EW08330%27 HTTP/1.1" 200 None
2026-01-28 17:07:43 [auto1.es] INFO: Saving data for EW08330: {'auction_closing_time': 1769702849.0, 'created_time': 1768324579.14152, 'last_price_update_time': 1769620063.239231}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EW08330') HTTP/1.1" 204 0
2026-01-28 17:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with identifier: UL07014
2026-01-28 17:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with identifier: UL07014
2026-01-28 17:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 39d17a7d-9348-508a-9313-d1fe80b6dbb9 with identifier: UL07014 to the API
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UL07014>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:45:36Z',
 'fuel_type': 'diesel',
 'id': '39d17a7d-9348-508a-9313-d1fe80b6dbb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL07014',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 81986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL07014%27 HTTP/1.1" 200 None
2026-01-28 17:07:43 [auto1.es] INFO: Saving data for UL07014: {'auction_closing_time': 1769705136.0, 'created_time': 1768401165.603837, 'last_price_update_time': 1769620063.561165}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UL07014') HTTP/1.1" 204 0
2026-01-28 17:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-01-28 17:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706
2026-01-28 17:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fe23f78e-e93e-5abd-acd9-b51972e14759 with identifier: KL07706 to the API
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KL07706>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:39:27Z',
 'fuel_type': 'diesel',
 'id': 'fe23f78e-e93e-5abd-acd9-b51972e14759',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL07706',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '3er',
 'odometer': 126768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KL07706%27 HTTP/1.1" 200 None
2026-01-28 17:07:43 [auto1.es] INFO: Saving data for KL07706: {'auction_closing_time': 1769704767.0, 'created_time': 1768401430.163099, 'last_price_update_time': 1769620063.875511}
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KL07706') HTTP/1.1" 204 0
2026-01-28 17:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_2cfc8a25557f3e41420046c590657b60.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_506e592d1360a95607b067425053eaae.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH18872> (referer: https://www.auto1.com/v1/car-details-view/AH18872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62730390>
2026-01-28 17:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg saved to cache
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63425110>
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_253ab1a124f4f17179369dcbb67dd78b.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_253ab1a124f4f17179369dcbb67dd78b.jpg saved to cache
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6355dd10>
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg saved to cache
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d6110>
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg saved to cache
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8964af39-df3b-5958-964c-906ed888a177 with identifier: ME28705
2026-01-28 17:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8964af39-df3b-5958-964c-906ed888a177 with scrape type 2
2026-01-28 17:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8964af39-df3b-5958-964c-906ed888a177 with scrape type 2
2026-01-28 17:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8964af39-df3b-5958-964c-906ed888a177, identifier: ME28705
2026-01-28 17:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_7678e01d6c0e5d5bef99b29311169083.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5f669c55b725f51cf44dccd102d22b01.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_27e6ab2e565bc1343301ee5108b796aa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_27e6ab2e565bc1343301ee5108b796aa.jpg not downloaded yet
2026-01-28 17:07:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8964af39-df3b-5958-964c-906ed888a177 with identifier: ME28705
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8964af39-df3b-5958-964c-906ed888a177 with identifier: ME28705
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8964af39-df3b-5958-964c-906ed888a177 spider: auto1.es
2026-01-28 17:07:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8964af39-df3b-5958-964c-906ed888a177 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:59:05Z',
 'fuel_type': 'diesel',
 'id': '8964af39-df3b-5958-964c-906ed888a177',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME28705',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 82351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME28705%27 HTTP/1.1" 200 None
2026-01-28 17:07:45 [auto1.es] INFO: Saving data for ME28705: {'auction_closing_time': 1769705945.0, 'created_time': 1769188482.949285, 'last_price_update_time': 1769620065.313091}
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME28705') HTTP/1.1" 204 0
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a94310>
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_31df61c726c2a7fcdad7ab3481511303.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_31df61c726c2a7fcdad7ab3481511303.jpg saved to cache
2026-01-28 17:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12bf571-72c4-5e96-824e-9c3053f5a0d9 with identifier: FB08932
2026-01-28 17:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12bf571-72c4-5e96-824e-9c3053f5a0d9 with scrape type 2
2026-01-28 17:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12bf571-72c4-5e96-824e-9c3053f5a0d9 with scrape type 2
2026-01-28 17:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e12bf571-72c4-5e96-824e-9c3053f5a0d9, identifier: FB08932
2026-01-28 17:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 318bfed9-d2ea-5466-91d8-f3e4214e3682 with identifier: PH24007
2026-01-28 17:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 318bfed9-d2ea-5466-91d8-f3e4214e3682 with scrape type 2
2026-01-28 17:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 318bfed9-d2ea-5466-91d8-f3e4214e3682 with scrape type 2
2026-01-28 17:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 318bfed9-d2ea-5466-91d8-f3e4214e3682, identifier: PH24007
2026-01-28 17:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9247854f3819f4493bac19596b6a7148.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e12bf571-72c4-5e96-824e-9c3053f5a0d9 with identifier: FB08932
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e12bf571-72c4-5e96-824e-9c3053f5a0d9 with identifier: FB08932
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157898 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157898
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: e12bf571-72c4-5e96-824e-9c3053f5a0d9 spider: auto1.es
2026-01-28 17:07:45 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e12bf571-72c4-5e96-824e-9c3053f5a0d9 due to rule: high_mileage_for_country.json, error: 157898 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157898
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:21:35Z',
 'fuel_type': 'diesel',
 'id': 'e12bf571-72c4-5e96-824e-9c3053f5a0d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB08932',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'C4 Grand Spacetourer',
 'odometer': 157898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Spacetourer 1.5 Blue-HDi Business +',
 'transmission': 'automatic',
 'trim': 'Business +',
 'year': 2019}
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB08932%27 HTTP/1.1" 200 None
2026-01-28 17:07:45 [auto1.es] INFO: Saving data for FB08932: {'auction_closing_time': 1769703695.0, 'created_time': 1767703520.7593, 'last_price_update_time': 1769620065.959686}
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FB08932') HTTP/1.1" 204 0
2026-01-28 17:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 318bfed9-d2ea-5466-91d8-f3e4214e3682 with identifier: PH24007
2026-01-28 17:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 318bfed9-d2ea-5466-91d8-f3e4214e3682 with identifier: PH24007
2026-01-28 17:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 318bfed9-d2ea-5466-91d8-f3e4214e3682 spider: auto1.es
2026-01-28 17:07:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 318bfed9-d2ea-5466-91d8-f3e4214e3682 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:43:40Z',
 'fuel_type': 'diesel',
 'id': '318bfed9-d2ea-5466-91d8-f3e4214e3682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH24007',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 168424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2022}
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PH24007%27 HTTP/1.1" 200 None
2026-01-28 17:07:46 [auto1.es] INFO: Saving data for PH24007: {'auction_closing_time': 1769705020.0, 'created_time': 1769101562.789633, 'last_price_update_time': 1769620066.189394}
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PH24007') HTTP/1.1" 204 0
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f7290>
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_104def9eec7f11f3b149b70f9a1437e7.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_104def9eec7f11f3b149b70f9a1437e7.jpg saved to cache
2026-01-28 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg not downloaded yet
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6296e150>
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg saved to cache
2026-01-28 17:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269bfd0>
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_2cfc8a25557f3e41420046c590657b60.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_2cfc8a25557f3e41420046c590657b60.jpg saved to cache
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628d4b90>
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F4a%252F354a97433d4928d6e3ec7d4716a96d2d%252Fpa%252FVT60667_506e592d1360a95607b067425053eaae.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_506e592d1360a95607b067425053eaae.jpg saved to cache
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26
2026-01-28 17:07:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26, skipping ID generation
2026-01-28 17:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with scrape type 1
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 from tracking dictionaries
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 sending to next pipeline
2026-01-28 17:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26, identifier: VT60667
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a15c90>
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg saved to cache
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 with identifier: AH18872
2026-01-28 17:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 with scrape type 2
2026-01-28 17:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 with scrape type 2
2026-01-28 17:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7, identifier: AH18872
2026-01-28 17:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9a575812b67e61cfac55e9abfbecd609.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with identifier: VT60667
2026-01-28 17:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with identifier: VT60667
2026-01-28 17:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b0aa42a-15d6-559b-9ab8-9b410ac86a26 with identifier: VT60667 to the API
2026-01-28 17:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_506e592d1360a95607b067425053eaae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:45:01Z',
 'fuel_type': 'diesel',
 'id': '4b0aa42a-15d6-559b-9ab8-9b410ac86a26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT60667',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 118068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_6ae2c285f90902bda1bd4f6975223168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e4b57731285070349d46a01326492553.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_e6b1d22c7c0b13eb622cff006a1c44c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_0373d2902439f646f17d72bdc9f4f50c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_45033cbc195bf562d8434cef78ce6200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_f6b55a428345d24f55d80a8b57d1bd45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_19e0c1ad1d3e30a844c6d669cee6b37d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_eea8cf0cfb9d150bb8e624f2965ec0d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_087e13b0ac1bc71d48148f2c41478a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_638bf8599f3ea518367dd7ad8fe6933f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_df2a40004639e004e669c38e48d33bab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_253ab1a124f4f17179369dcbb67dd78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_65f2c1f98dc9f36305e9ba22dea035a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_506e592d1360a95607b067425053eaae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0aa42a-15d6-559b-9ab8-9b410ac86a26/4b0aa42a-15d6-559b-9ab8-9b410ac86a26_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/4a/354a97433d4928d6e3ec7d4716a96d2d/pa/VT60667_abf0d819ee2fc72adfe7c265f3dba951.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2021}
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT60667%27 HTTP/1.1" 200 None
2026-01-28 17:07:48 [auto1.es] INFO: Saving data for VT60667: {'created_time': 1769620068.197537, 'last_price_update_time': 1769620068.197552, 'auction_closing_time': 1769705101.0}
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VT60667') HTTP/1.1" 204 0
2026-01-28 17:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 with identifier: AH18872
2026-01-28 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 with identifier: AH18872
2026-01-28 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 spider: auto1.es
2026-01-28 17:07:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9be8c95d-b1e6-5b3b-bf88-04b853e346d7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:00:08Z',
 'fuel_type': 'diesel',
 'id': '9be8c95d-b1e6-5b3b-bf88-04b853e346d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH18872',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 126264,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH18872%27 HTTP/1.1" 200 None
2026-01-28 17:07:48 [auto1.es] INFO: Saving data for AH18872: {'auction_closing_time': 1769702408.0, 'created_time': 1768324463.063708, 'last_price_update_time': 1769620068.421179}
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH18872') HTTP/1.1" 204 0
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627d8d10>
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_7678e01d6c0e5d5bef99b29311169083.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_7678e01d6c0e5d5bef99b29311169083.jpg saved to cache
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a09ad0>
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F18%252F8b1843c4ece7751c6be68c881fb23ff4%252Fpa%252FVR29926_5f669c55b725f51cf44dccd102d22b01.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5f669c55b725f51cf44dccd102d22b01.jpg saved to cache
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195
2026-01-28 17:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b20dd3b1-cc62-5aac-aa7f-e554e0f94195, skipping ID generation
2026-01-28 17:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with scrape type 1
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 from tracking dictionaries
2026-01-28 17:07:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b20dd3b1-cc62-5aac-aa7f-e554e0f94195 sending to next pipeline
2026-01-28 17:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b20dd3b1-cc62-5aac-aa7f-e554e0f94195, identifier: VR29926
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_43628e7ed2cd5f1f323cd00381b26040.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_43628e7ed2cd5f1f323cd00381b26040.jpg not downloaded yet
2026-01-28 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TB32811> (referer: https://www.auto1.com/v1/car-details-view/TB32811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-01-28 17:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926
2026-01-28 17:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b20dd3b1-cc62-5aac-aa7f-e554e0f94195 with identifier: VR29926 to the API
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5f669c55b725f51cf44dccd102d22b01.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:21:31Z',
 'fuel_type': 'petrol',
 'id': 'b20dd3b1-cc62-5aac-aa7f-e554e0f94195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR29926',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 43174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_b227b40daaca832783f1d79f1111507d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_9900e66ad90082c4190bb677d173075a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_f7dcec2ff98733feb4354d1e801e5ccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_94e59496e77591817cce7b58613a4150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_0a11eb43f19a3a3ca0cf9300c60caa50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5da7be5cd5224caa775467af66f3b5cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_159da044dfb20670a36bb50ea0fc812b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_955399c6f36fe4ebe488e0d3a8a0bbd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_99df3d568d8c354b02fea32027a80e71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eb6640c15aa066ab1e0248fae7e154dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_ada271fd0d7eccdccb9e38a1eb44e37a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_320e7828c30059ef514bbb05e0ebe822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_2cfc8a25557f3e41420046c590657b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_eda3b36811ef6c9b201ef4badd9b2a7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_54dc8d29d1f56f2bbade423da340eb1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b20dd3b1-cc62-5aac-aa7f-e554e0f94195/b20dd3b1-cc62-5aac-aa7f-e554e0f94195_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/18/8b1843c4ece7751c6be68c881fb23ff4/pa/VR29926_5f669c55b725f51cf44dccd102d22b01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2022}
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VR29926%27 HTTP/1.1" 200 None
2026-01-28 17:07:49 [auto1.es] INFO: Saving data for VR29926: {'created_time': 1769620069.381375, 'last_price_update_time': 1769620069.38139, 'auction_closing_time': 1769703691.0}
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VR29926') HTTP/1.1" 204 0
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288a550>
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_17.jpg HTTP/1.1" 201 0
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F3a%252F113a3d94f0c721324b37f34b27a67657%252Fpa%252FYV54140_9247854f3819f4493bac19596b6a7148.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9247854f3819f4493bac19596b6a7148.jpg saved to cache
2026-01-28 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7
2026-01-28 17:07:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7, skipping ID generation
2026-01-28 17:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with scrape type 1
2026-01-28 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 from tracking dictionaries
2026-01-28 17:07:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 sending to next pipeline
2026-01-28 17:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7, identifier: YV54140
2026-01-28 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX76519/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JW95556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with identifier: YV54140
2026-01-28 17:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with identifier: YV54140
2026-01-28 17:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 798ac486-f82e-5fe6-b9f0-29b2ae1802f7 with identifier: YV54140 to the API
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9247854f3819f4493bac19596b6a7148.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:03:40Z',
 'fuel_type': 'electro',
 'id': '798ac486-f82e-5fe6-b9f0-29b2ae1802f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV54140',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'Inster',
 'odometer': 10909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9397a2ed0aeede3f997cf231a7554a89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_8f9c6475323f7358a5563573dd6f15ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_72d74d71ddef8ed84cf379bc79062801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_99e5f5b589f26e619592fe2a16ce6334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_42f7175d1c32aa154126f5d281a6611a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9d6f8b4d4bf93e56ffba479c8955502c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_7f4922841688de169a7c3a381beba592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_16a747e5dc940e001bd665a4b7ab2c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e9f351e7135e38e57e22d8bd111d5885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_e106f576c9805e3cf81eb8f63e51ca20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_622a4e394d64404f1fd74783d29ea07a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_54c2fd8eddff7d5b35172e9bff502d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_11031da5fe297ce438d6ea73cd31d380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_1d0ffea94f2d8339098835b9beafb1c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_024125ae68dcd7a543bce3e1718e14cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_b1262077d569b55f43c2ec647756a946.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_c35474996e4d8e56660ef11381137f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_9247854f3819f4493bac19596b6a7148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798ac486-f82e-5fe6-b9f0-29b2ae1802f7/798ac486-f82e-5fe6-b9f0-29b2ae1802f7_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/3a/113a3d94f0c721324b37f34b27a67657/pa/YV54140_306c71f69c949d8a98a939f3ce2d7f74.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-05-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Hyundai Inster electric drive 85 kW Maxx',
 'transmission': 'automatic',
 'trim': 'Maxx',
 'year': 2025}
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YV54140%27 HTTP/1.1" 200 None
2026-01-28 17:07:50 [auto1.es] INFO: Saving data for YV54140: {'created_time': 1769620070.094424, 'last_price_update_time': 1769620070.094434, 'auction_closing_time': 1769702620.0}
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YV54140') HTTP/1.1" 204 0
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b698dc910>
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg saved to cache
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_3368261e6946a5a1b6997b5224fcb288.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_3368261e6946a5a1b6997b5224fcb288.jpg not downloaded yet
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ace10>
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_9a575812b67e61cfac55e9abfbecd609.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9a575812b67e61cfac55e9abfbecd609.jpg saved to cache
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_27e6ab2e565bc1343301ee5108b796aa.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH73638/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ98795/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD85215/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GD68452> (referer: https://www.auto1.com/v1/car-details-view/GD68452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daff0443-bfdc-5013-a5b0-b8c8299aa90b with identifier: TB32811
2026-01-28 17:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daff0443-bfdc-5013-a5b0-b8c8299aa90b with scrape type 2
2026-01-28 17:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daff0443-bfdc-5013-a5b0-b8c8299aa90b with scrape type 2
2026-01-28 17:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: daff0443-bfdc-5013-a5b0-b8c8299aa90b, identifier: TB32811
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: daff0443-bfdc-5013-a5b0-b8c8299aa90b with identifier: TB32811
2026-01-28 17:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: daff0443-bfdc-5013-a5b0-b8c8299aa90b with identifier: TB32811
2026-01-28 17:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: daff0443-bfdc-5013-a5b0-b8c8299aa90b spider: auto1.es
2026-01-28 17:07:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: daff0443-bfdc-5013-a5b0-b8c8299aa90b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:25:05Z',
 'fuel_type': 'diesel',
 'id': 'daff0443-bfdc-5013-a5b0-b8c8299aa90b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB32811',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 156007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Business',
 'transmission': 'manual',
 'trim': 'Active Business',
 'year': 2023}
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB32811%27 HTTP/1.1" 200 None
2026-01-28 17:07:50 [auto1.es] INFO: Saving data for TB32811: {'auction_closing_time': 1769703905.0, 'created_time': 1768324054.874179, 'last_price_update_time': 1769620070.930059}
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TB32811') HTTP/1.1" 204 0
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62767b90>
2026-01-28 17:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg saved to cache
2026-01-28 17:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_43628e7ed2cd5f1f323cd00381b26040.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ae450>
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_27e6ab2e565bc1343301ee5108b796aa.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_27e6ab2e565bc1343301ee5108b796aa.jpg saved to cache
2026-01-28 17:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018e20f7-44bf-5b39-9012-b99bfedfd19c with identifier: GD68452
2026-01-28 17:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018e20f7-44bf-5b39-9012-b99bfedfd19c with scrape type 2
2026-01-28 17:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018e20f7-44bf-5b39-9012-b99bfedfd19c with scrape type 2
2026-01-28 17:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 018e20f7-44bf-5b39-9012-b99bfedfd19c, identifier: GD68452
2026-01-28 17:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 018e20f7-44bf-5b39-9012-b99bfedfd19c with identifier: GD68452
2026-01-28 17:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 018e20f7-44bf-5b39-9012-b99bfedfd19c with identifier: GD68452
2026-01-28 17:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2026-01-28 17:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 018e20f7-44bf-5b39-9012-b99bfedfd19c spider: auto1.es
2026-01-28 17:07:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 018e20f7-44bf-5b39-9012-b99bfedfd19c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:55:04Z',
 'fuel_type': 'diesel',
 'id': '018e20f7-44bf-5b39-9012-b99bfedfd19c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD68452',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'ProAce City',
 'odometer': 136420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-05',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota ProAce City 1.5 D-4D Combi L1 GX',
 'transmission': 'manual',
 'trim': 'Combi L1 GX',
 'year': 2021}
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GD68452%27 HTTP/1.1" 200 None
2026-01-28 17:07:51 [auto1.es] INFO: Saving data for GD68452: {'auction_closing_time': 1769705704.0, 'created_time': 1768401536.885223, 'last_price_update_time': 1769620071.773446}
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GD68452') HTTP/1.1" 204 0
2026-01-28 17:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_3368261e6946a5a1b6997b5224fcb288.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC08387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62704590>
2026-01-28 17:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_16.jpg HTTP/1.1" 201 0
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg saved to cache
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62637250>
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_17.jpg HTTP/1.1" 201 0
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_43628e7ed2cd5f1f323cd00381b26040.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_43628e7ed2cd5f1f323cd00381b26040.jpg saved to cache
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269bcd0>
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_18.jpg HTTP/1.1" 201 0
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga1%252Fc0%252Fa1c078eefe00b23a1e0514da51911bef%252Fpa%252FLA81893_3368261e6946a5a1b6997b5224fcb288.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_3368261e6946a5a1b6997b5224fcb288.jpg saved to cache
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303
2026-01-28 17:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303, skipping ID generation
2026-01-28 17:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with scrape type 1
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 from tracking dictionaries
2026-01-28 17:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 sending to next pipeline
2026-01-28 17:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303, identifier: LA81893
2026-01-28 17:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with identifier: LA81893
2026-01-28 17:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with identifier: LA81893
2026-01-28 17:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f6e7580-3cb3-5ccc-ac25-5aa584e67303 with identifier: LA81893 to the API
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_3368261e6946a5a1b6997b5224fcb288.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 252,
 'expiration_date': '2026-01-29T16:52:21Z',
 'fuel_type': 'hybrid',
 'id': '9f6e7580-3cb3-5ccc-ac25-5aa584e67303',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA81893',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 2850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_dc4f1037c3a4054708ba2df7958eadfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106185,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_7678e01d6c0e5d5bef99b29311169083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_0a5dfcc5f26f76e2a133e9623b04e411.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5d8c1b88a779d3c57807e41151963a50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_a847dacbf4e561a7f33daac89988c26a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9609e54f2b5cf9e27cdb2c809dd52cc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_bdc9ee57ed44ff5aa84f3fadc74febd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d1c08cd9e285d709804b2f2dad7cfc76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_fb5cca672492cbb96c91bd4b2ee0d51a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_d28f5a0c1af5b61249a5793c76a747ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_31df61c726c2a7fcdad7ab3481511303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_104def9eec7f11f3b149b70f9a1437e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_20d09dc1e248003b8cd8f5fbffc1ddd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_9a575812b67e61cfac55e9abfbecd609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_5cfcef53db3f5001fcc273d6db5ba4b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_27e6ab2e565bc1343301ee5108b796aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_c009253629a7460a1268d2ecfc5eb4d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_43628e7ed2cd5f1f323cd00381b26040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f6e7580-3cb3-5ccc-ac25-5aa584e67303/9f6e7580-3cb3-5ccc-ac25-5aa584e67303_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga1/c0/a1c078eefe00b23a1e0514da51911bef/pa/LA81893_3368261e6946a5a1b6997b5224fcb288.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2025-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Plug-in Hybrid 20 Aniversario 2WD',
 'transmission': 'automatic',
 'trim': '20 Aniversario 2WD',
 'year': 2025}
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LA81893%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Saving data for LA81893: {'created_time': 1769620073.018432, 'last_price_update_time': 1769620073.018443, 'auction_closing_time': 1769705541.0}
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LA81893') HTTP/1.1" 204 0
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU48427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU95928/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SU76295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX91241> (referer: https://www.auto1.com/v1/car-details-view/LX91241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:07:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb03a1cf-fb90-5de2-b16c-d6a77e63f816 with identifier: LX91241
2026-01-28 17:07:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb03a1cf-fb90-5de2-b16c-d6a77e63f816 with scrape type 1
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item fb03a1cf-fb90-5de2-b16c-d6a77e63f816
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_f7f7acdb03cf60677243d5137846af26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f7f7acdb03cf60677243d5137846af26.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_e92613219db524148d2ada90b0a20b12.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e92613219db524148d2ada90b0a20b12.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_605f8b8cf0c2e2b475cd2694facdd778.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_605f8b8cf0c2e2b475cd2694facdd778.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_0f5a98704890855eb60a8d73d77cc0bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_0f5a98704890855eb60a8d73d77cc0bd.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_e4f49da4a47560bd721f106508e02112.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e4f49da4a47560bd721f106508e02112.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_8ba91eaa7f47ec24ab13e0b239e7b9a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_8ba91eaa7f47ec24ab13e0b239e7b9a3.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_62a60392857315eca5c5665edb169b3a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_62a60392857315eca5c5665edb169b3a.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_3cc1edc34295a397cd0011959b28e6fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3cc1edc34295a397cd0011959b28e6fb.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_f9272a965064429803c831414e17c253.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f9272a965064429803c831414e17c253.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_be30a502e0d9cdb8de7f1b6eecdb2dc9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_be30a502e0d9cdb8de7f1b6eecdb2dc9.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_3e512c33c58cff8b425b8fc0f6a745b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3e512c33c58cff8b425b8fc0f6a745b4.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_ddb861aca88e7fb18528a66735ec8520.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_ddb861aca88e7fb18528a66735ec8520.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_b073248d58cef50226b8f263db3d4f96.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_b073248d58cef50226b8f263db3d4f96.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_4e3ba5ea0e87a37f0f96ede1d9fb1ad9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_4e3ba5ea0e87a37f0f96ede1d9fb1ad9.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_9075b3913007b84fd64cc3a46f451c8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_9075b3913007b84fd64cc3a46f451c8d.jpg already downloaded
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F20%252F4720e3b31fcf287a0f177a28f6ecc25a%252Fpa%252FLX91241_5140073f961e83e36feedbd1c4659640.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_5140073f961e83e36feedbd1c4659640.jpg already downloaded
2026-01-28 17:07:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fb03a1cf-fb90-5de2-b16c-d6a77e63f816, identifier: LX91241
2026-01-28 17:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fb03a1cf-fb90-5de2-b16c-d6a77e63f816 with identifier: LX91241
2026-01-28 17:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fb03a1cf-fb90-5de2-b16c-d6a77e63f816 with identifier: LX91241
2026-01-28 17:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fb03a1cf-fb90-5de2-b16c-d6a77e63f816 spider: auto1.es
2026-01-28 17:07:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: fb03a1cf-fb90-5de2-b16c-d6a77e63f816 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:17:46Z',
 'fuel_type': 'diesel',
 'id': 'fb03a1cf-fb90-5de2-b16c-d6a77e63f816',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX91241',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 125204,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f7f7acdb03cf60677243d5137846af26.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e92613219db524148d2ada90b0a20b12.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_605f8b8cf0c2e2b475cd2694facdd778.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_0f5a98704890855eb60a8d73d77cc0bd.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e4f49da4a47560bd721f106508e02112.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_8ba91eaa7f47ec24ab13e0b239e7b9a3.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_62a60392857315eca5c5665edb169b3a.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3cc1edc34295a397cd0011959b28e6fb.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f9272a965064429803c831414e17c253.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_be30a502e0d9cdb8de7f1b6eecdb2dc9.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3e512c33c58cff8b425b8fc0f6a745b4.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_ddb861aca88e7fb18528a66735ec8520.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_b073248d58cef50226b8f263db3d4f96.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_4e3ba5ea0e87a37f0f96ede1d9fb1ad9.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_9075b3913007b84fd64cc3a46f451c8d.jpg',
                'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_5140073f961e83e36feedbd1c4659640.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f7f7acdb03cf60677243d5137846af26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e92613219db524148d2ada90b0a20b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_605f8b8cf0c2e2b475cd2694facdd778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_0f5a98704890855eb60a8d73d77cc0bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_e4f49da4a47560bd721f106508e02112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_8ba91eaa7f47ec24ab13e0b239e7b9a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_62a60392857315eca5c5665edb169b3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3cc1edc34295a397cd0011959b28e6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_f9272a965064429803c831414e17c253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_be30a502e0d9cdb8de7f1b6eecdb2dc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_3e512c33c58cff8b425b8fc0f6a745b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_ddb861aca88e7fb18528a66735ec8520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_b073248d58cef50226b8f263db3d4f96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_4e3ba5ea0e87a37f0f96ede1d9fb1ad9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_9075b3913007b84fd64cc3a46f451c8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb03a1cf-fb90-5de2-b16c-d6a77e63f816/fb03a1cf-fb90-5de2-b16c-d6a77e63f816_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/20/4720e3b31fcf287a0f177a28f6ecc25a/pa/LX91241_5140073f961e83e36feedbd1c4659640.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active L1',
 'transmission': 'manual',
 'trim': 'Active L1',
 'year': 2021}
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX91241%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Saving data for LX91241: {'created_time': 1769620073.746603, 'last_price_update_time': 1769620073.746614, 'auction_closing_time': 1769703466.0}
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LX91241') HTTP/1.1" 204 0
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: DM21267
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM21267%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for DM21267: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: CH74884
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH74884%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for CH74884: 1
2026-01-28 17:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB74066/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: AE99486
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE99486%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for AE99486: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: UX97052
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX97052%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for UX97052: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: AL50426
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL50426%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for AL50426: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: NP31534
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP31534%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for NP31534: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: LM22343
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM22343%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for LM22343: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: YC11902
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC11902%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for YC11902: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: HV22353
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV22353%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for HV22353: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: NN14393
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN14393%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for NN14393: 1
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: CF88486
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CF88486%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for CF88486: 0
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: HA84402
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA84402%27 HTTP/1.1" 200 None
2026-01-28 17:07:53 [auto1.es] INFO: Scrape type for HA84402: 2
2026-01-28 17:07:53 [auto1.es] INFO: Found listing with ID: HY66255
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY66255%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for HY66255: 1
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: AY15178
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY15178%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for AY15178: 1
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: GL69092
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL69092%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for GL69092: 2
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: DV21475
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV21475%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for DV21475: 1
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: YJ38714
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ38714%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for YJ38714: 1
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: XR99228
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR99228%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for XR99228: 2
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: TE12893
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TE12893%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for TE12893: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: JB57039
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB57039%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for JB57039: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: AA89262
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AA89262%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for AA89262: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: RM03359
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM03359%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for RM03359: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: XT95954
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XT95954%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for XT95954: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: VA57807
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VA57807%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for VA57807: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: GX71832
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX71832%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for GX71832: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: CA66568
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA66568%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for CA66568: 2
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: GZ80294
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GZ80294%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for GZ80294: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: DH47763
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH47763%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for DH47763: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: VT13561
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VT13561%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for VT13561: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: ED84025
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ED84025%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for ED84025: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: MW11929
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MW11929%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for MW11929: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: EV88095
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV88095%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for EV88095: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: LH71746
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LH71746%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for LH71746: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: YU15845
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU15845%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for YU15845: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: AG92925
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG92925%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for AG92925: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: HC54242
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HC54242%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for HC54242: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: XL70803
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL70803%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for XL70803: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: FC31020
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FC31020%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for FC31020: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: UN99585
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN99585%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for UN99585: 0
2026-01-28 17:07:54 [auto1.es] INFO: Found listing with ID: AS88754
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS88754%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [auto1.es] INFO: Scrape type for AS88754: 0
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR03332/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL25416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF05648> (referer: https://www.auto1.com/v1/car-details-view/XF05648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f594ca68-ca09-554c-9bc7-97cff8f46a7d with identifier: XF05648
2026-01-28 17:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f594ca68-ca09-554c-9bc7-97cff8f46a7d with scrape type 1
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_fedc245bfc110505dfbe8588b75717d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_fedc245bfc110505dfbe8588b75717d9.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0991dd96a5390d81314fca0069842d71.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0991dd96a5390d81314fca0069842d71.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_ca59341edb4bdba3607a411125a4fa96.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_ca59341edb4bdba3607a411125a4fa96.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg not downloaded yet
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KB87556> (referer: https://www.auto1.com/v1/car-details-view/KB87556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_1806422a90dfb2fd460e273fd90144db.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_1806422a90dfb2fd460e273fd90144db.jpg not downloaded yet
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ45268> (referer: https://www.auto1.com/v1/car-details-view/YJ45268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JW95556> (referer: https://www.auto1.com/v1/car-details-view/JW95556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg not downloaded yet
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_c5e5484848f1c5fec752b33cd9670a06.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_c5e5484848f1c5fec752b33cd9670a06.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg not downloaded yet
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg not downloaded yet
2026-01-28 17:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with identifier: KB87556
2026-01-28 17:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with scrape type 2
2026-01-28 17:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with scrape type 2
2026-01-28 17:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fc0a477c-e2f5-5675-9c9c-3179a29b8d0b, identifier: KB87556
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_9706ff0adda4775b43f3a0036f66dd78.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_9706ff0adda4775b43f3a0036f66dd78.jpg not downloaded yet
2026-01-28 17:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with identifier: KB87556
2026-01-28 17:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with identifier: KB87556
2026-01-28 17:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fc0a477c-e2f5-5675-9c9c-3179a29b8d0b with identifier: KB87556 to the API
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KB87556>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:55:12Z',
 'fuel_type': 'petrol',
 'id': 'fc0a477c-e2f5-5675-9c9c-3179a29b8d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB87556',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 38495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2022}
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KB87556%27 HTTP/1.1" 200 None
2026-01-28 17:07:55 [auto1.es] INFO: Saving data for KB87556: {'auction_closing_time': 1769705712.0, 'created_time': 1769187958.946056, 'last_price_update_time': 1769620075.392736}
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KB87556') HTTP/1.1" 204 0
2026-01-28 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with identifier: YJ45268
2026-01-28 17:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with scrape type 2
2026-01-28 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with scrape type 2
2026-01-28 17:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ad3d081-394f-5faa-8c68-87ab7d6b3f49, identifier: YJ45268
2026-01-28 17:07:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a24f6d1e-0069-5af9-8f4a-76cb53fdc241 with identifier: JW95556
2026-01-28 17:07:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a24f6d1e-0069-5af9-8f4a-76cb53fdc241 with scrape type 2
2026-01-28 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a24f6d1e-0069-5af9-8f4a-76cb53fdc241 with scrape type 2
2026-01-28 17:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a24f6d1e-0069-5af9-8f4a-76cb53fdc241, identifier: JW95556
2026-01-28 17:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_1806422a90dfb2fd460e273fd90144db.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_7417635fd041f8f3af3ac523f6520d0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7417635fd041f8f3af3ac523f6520d0c.jpg not downloaded yet
2026-01-28 17:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with identifier: YJ45268
2026-01-28 17:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with identifier: YJ45268
2026-01-28 17:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ad3d081-394f-5faa-8c68-87ab7d6b3f49 with identifier: YJ45268 to the API
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YJ45268>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:19:56Z',
 'fuel_type': 'petrol',
 'id': '6ad3d081-394f-5faa-8c68-87ab7d6b3f49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ45268',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 68304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2021}
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ45268%27 HTTP/1.1" 200 None
2026-01-28 17:07:56 [auto1.es] INFO: Saving data for YJ45268: {'auction_closing_time': 1769703596.0, 'created_time': 1769003019.473818, 'last_price_update_time': 1769620076.047976}
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ45268') HTTP/1.1" 204 0
2026-01-28 17:07:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a24f6d1e-0069-5af9-8f4a-76cb53fdc241 with identifier: JW95556
2026-01-28 17:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a24f6d1e-0069-5af9-8f4a-76cb53fdc241 with identifier: JW95556
2026-01-28 17:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:07:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a24f6d1e-0069-5af9-8f4a-76cb53fdc241 spider: auto1.es
2026-01-28 17:07:56 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a24f6d1e-0069-5af9-8f4a-76cb53fdc241 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:07:11Z',
 'fuel_type': 'diesel',
 'id': 'a24f6d1e-0069-5af9-8f4a-76cb53fdc241',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW95556',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 88813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW95556%27 HTTP/1.1" 200 None
2026-01-28 17:07:56 [auto1.es] INFO: Saving data for JW95556: {'auction_closing_time': 1769702831.0, 'created_time': 1768401143.735749, 'last_price_update_time': 1769620076.264418}
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JW95556') HTTP/1.1" 204 0
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX76519> (referer: https://www.auto1.com/v1/car-details-view/PX76519/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg not downloaded yet
2026-01-28 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD85215> (referer: https://www.auto1.com/v1/car-details-view/LD85215/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ98795> (referer: https://www.auto1.com/v1/car-details-view/FZ98795/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628d7a50>
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg saved to cache
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC08387> (referer: https://www.auto1.com/v1/car-details-view/AC08387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629fb310>
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_1806422a90dfb2fd460e273fd90144db.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_1806422a90dfb2fd460e273fd90144db.jpg saved to cache
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_9706ff0adda4775b43f3a0036f66dd78.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_761bdd607b66f59452e3c225ddbd5e02.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_761bdd607b66f59452e3c225ddbd5e02.jpg not downloaded yet
2026-01-28 17:07:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-01-28 17:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with scrape type 2
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with scrape type 2
2026-01-28 17:07:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd, identifier: PX76519
2026-01-28 17:07:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe with identifier: LD85215
2026-01-28 17:07:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe with scrape type 2
2026-01-28 17:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe with scrape type 2
2026-01-28 17:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe, identifier: LD85215
2026-01-28 17:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9370910-a932-5848-8323-a428520246ab with identifier: FZ98795
2026-01-28 17:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9370910-a932-5848-8323-a428520246ab with scrape type 2
2026-01-28 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9370910-a932-5848-8323-a428520246ab with scrape type 2
2026-01-28 17:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9370910-a932-5848-8323-a428520246ab, identifier: FZ98795
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg not downloaded yet
2026-01-28 17:07:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ND01122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519
2026-01-28 17:07:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: bdda3c2b-ce2c-55f4-998e-1c33fb266dfd with identifier: PX76519 to the API
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:07:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX76519>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:37:20Z',
 'fuel_type': 'petrol',
 'id': 'bdda3c2b-ce2c-55f4-998e-1c33fb266dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX76519',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 47031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Mild-Hybrid Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2023}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX76519%27 HTTP/1.1" 200 None
2026-01-28 17:07:57 [auto1.es] INFO: Saving data for PX76519: {'auction_closing_time': 1769704640.0, 'created_time': 1768401241.554092, 'last_price_update_time': 1769620077.452233}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX76519') HTTP/1.1" 204 0
2026-01-28 17:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe with identifier: LD85215
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe with identifier: LD85215
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe spider: auto1.es
2026-01-28 17:07:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:12:48Z',
 'fuel_type': 'diesel',
 'id': 'ee5db3aa-0202-5fb7-9f3c-bdc8db0b37fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD85215',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 132807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD85215%27 HTTP/1.1" 200 None
2026-01-28 17:07:57 [auto1.es] INFO: Saving data for LD85215: {'auction_closing_time': 1769703168.0, 'created_time': 1768324174.410352, 'last_price_update_time': 1769620077.683621}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LD85215') HTTP/1.1" 204 0
2026-01-28 17:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9370910-a932-5848-8323-a428520246ab with identifier: FZ98795
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9370910-a932-5848-8323-a428520246ab with identifier: FZ98795
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f9370910-a932-5848-8323-a428520246ab spider: auto1.es
2026-01-28 17:07:57 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f9370910-a932-5848-8323-a428520246ab due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:20:43Z',
 'fuel_type': 'diesel',
 'id': 'f9370910-a932-5848-8323-a428520246ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ98795',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 143263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FZ98795%27 HTTP/1.1" 200 None
2026-01-28 17:07:57 [auto1.es] INFO: Saving data for FZ98795: {'auction_closing_time': 1769703643.0, 'created_time': 1768324264.160631, 'last_price_update_time': 1769620077.910558}
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FZ98795') HTTP/1.1" 204 0
2026-01-28 17:07:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe2b989-b104-5454-b55a-cd8e0c8646da with identifier: AC08387
2026-01-28 17:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe2b989-b104-5454-b55a-cd8e0c8646da with scrape type 2
2026-01-28 17:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abe2b989-b104-5454-b55a-cd8e0c8646da with scrape type 2
2026-01-28 17:07:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: abe2b989-b104-5454-b55a-cd8e0c8646da, identifier: AC08387
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7417635fd041f8f3af3ac523f6520d0c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: abe2b989-b104-5454-b55a-cd8e0c8646da with identifier: AC08387
2026-01-28 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: abe2b989-b104-5454-b55a-cd8e0c8646da with identifier: AC08387
2026-01-28 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146728 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146728
2026-01-28 17:07:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: abe2b989-b104-5454-b55a-cd8e0c8646da spider: auto1.es
2026-01-28 17:07:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: abe2b989-b104-5454-b55a-cd8e0c8646da due to rule: high_mileage_for_make.json, error: 146728 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146728
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:28:16Z',
 'fuel_type': 'diesel',
 'id': 'abe2b989-b104-5454-b55a-cd8e0c8646da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC08387',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 146728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2022}
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AC08387%27 HTTP/1.1" 200 None
2026-01-28 17:07:58 [auto1.es] INFO: Saving data for AC08387: {'auction_closing_time': 1769704096.0, 'created_time': 1768323790.550161, 'last_price_update_time': 1769620078.245107}
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AC08387') HTTP/1.1" 204 0
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF79816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e70d0>
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_9706ff0adda4775b43f3a0036f66dd78.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_9706ff0adda4775b43f3a0036f66dd78.jpg saved to cache
2026-01-28 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634ee690>
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg saved to cache
2026-01-28 17:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_c5e5484848f1c5fec752b33cd9670a06.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH73638> (referer: https://www.auto1.com/v1/car-details-view/GH73638/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RM01009/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62955dd0>
2026-01-28 17:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_7417635fd041f8f3af3ac523f6520d0c.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7417635fd041f8f3af3ac523f6520d0c.jpg saved to cache
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635698d0>
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg saved to cache
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62930150>
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg saved to cache
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8f0d0>
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg saved to cache
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291cc10>
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg') HTTP/1.1" 204 0
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg saved to cache
2026-01-28 17:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_761bdd607b66f59452e3c225ddbd5e02.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_fedc245bfc110505dfbe8588b75717d9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0991dd96a5390d81314fca0069842d71.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ84403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA66568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM21267/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c4990>
2026-01-28 17:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_c5e5484848f1c5fec752b33cd9670a06.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_c5e5484848f1c5fec752b33cd9670a06.jpg saved to cache
2026-01-28 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 with identifier: GH73638
2026-01-28 17:08:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 with scrape type 2
2026-01-28 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 with scrape type 2
2026-01-28 17:08:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4, identifier: GH73638
2026-01-28 17:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 with identifier: GH73638
2026-01-28 17:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 with identifier: GH73638
2026-01-28 17:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:08:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 spider: auto1.es
2026-01-28 17:08:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b1a2ddef-a67d-5201-8d06-fdacad2e3ef4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:22:49Z',
 'fuel_type': 'diesel',
 'id': 'b1a2ddef-a67d-5201-8d06-fdacad2e3ef4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH73638',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 114184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GH73638%27 HTTP/1.1" 200 None
2026-01-28 17:08:00 [auto1.es] INFO: Saving data for GH73638: {'auction_closing_time': 1769703769.0, 'created_time': 1768401997.535118, 'last_price_update_time': 1769620080.550468}
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GH73638') HTTP/1.1" 204 0
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8d190>
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_761bdd607b66f59452e3c225ddbd5e02.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_761bdd607b66f59452e3c225ddbd5e02.jpg saved to cache
2026-01-28 17:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357a310>
2026-01-28 17:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_fedc245bfc110505dfbe8588b75717d9.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_fedc245bfc110505dfbe8588b75717d9.jpg saved to cache
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628a0d90>
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_0991dd96a5390d81314fca0069842d71.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0991dd96a5390d81314fca0069842d71.jpg saved to cache
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b5bd0>
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg saved to cache
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628a2790>
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg saved to cache
2026-01-28 17:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR99228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_ca59341edb4bdba3607a411125a4fa96.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636420d0>
2026-01-28 17:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F20%252F8d208bfc95708cef356dbb6396432c0b%252Fpa%252FXF05648_ca59341edb4bdba3607a411125a4fa96.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_ca59341edb4bdba3607a411125a4fa96.jpg saved to cache
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f594ca68-ca09-554c-9bc7-97cff8f46a7d
2026-01-28 17:08:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f594ca68-ca09-554c-9bc7-97cff8f46a7d, skipping ID generation
2026-01-28 17:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f594ca68-ca09-554c-9bc7-97cff8f46a7d with scrape type 1
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f594ca68-ca09-554c-9bc7-97cff8f46a7d from tracking dictionaries
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f594ca68-ca09-554c-9bc7-97cff8f46a7d sending to next pipeline
2026-01-28 17:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f594ca68-ca09-554c-9bc7-97cff8f46a7d, identifier: XF05648
2026-01-28 17:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f594ca68-ca09-554c-9bc7-97cff8f46a7d with identifier: XF05648
2026-01-28 17:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f594ca68-ca09-554c-9bc7-97cff8f46a7d with identifier: XF05648
2026-01-28 17:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f594ca68-ca09-554c-9bc7-97cff8f46a7d with identifier: XF05648 to the API
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_ca59341edb4bdba3607a411125a4fa96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 30,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 394,
 'expiration_date': '2026-01-29T16:02:57Z',
 'fuel_type': 'hybrid',
 'id': 'f594ca68-ca09-554c-9bc7-97cff8f46a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF05648',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 127178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_fedc245bfc110505dfbe8588b75717d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0991dd96a5390d81314fca0069842d71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_ca59341edb4bdba3607a411125a4fa96.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7f330ba9d6d0fa45fe457d8e5ef4f540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_1806422a90dfb2fd460e273fd90144db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_b4c22c2681d21640dbe6d9b170639b1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_2ad7ba51f46f7fd9d8e03f88b66ae340.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_c5e5484848f1c5fec752b33cd9670a06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_e708e1c965e81d7c4d5da4ebbed6ecff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0a038e9bb5068cc98ade60eebd405ffb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_f6f8ba0a5c0ea5ccf9d6f3bcca8d9e8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_9706ff0adda4775b43f3a0036f66dd78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_7417635fd041f8f3af3ac523f6520d0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_0b1ca80928f8019a4c7d3d17ca9a5c74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_761bdd607b66f59452e3c225ddbd5e02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f594ca68-ca09-554c-9bc7-97cff8f46a7d/f594ca68-ca09-554c-9bc7-97cff8f46a7d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/20/8d208bfc95708cef356dbb6396432c0b/pa/XF05648_85402da9e07fe8d7d538e70ca1a3d6cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 45e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XF05648%27 HTTP/1.1" 200 None
2026-01-28 17:08:02 [auto1.es] INFO: Saving data for XF05648: {'created_time': 1769620082.654169, 'last_price_update_time': 1769620082.654182, 'auction_closing_time': 1769702577.0}
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XF05648') HTTP/1.1" 204 0
2026-01-28 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL69092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY15178/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR03332> (referer: https://www.auto1.com/v1/car-details-view/BR03332/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL25416> (referer: https://www.auto1.com/v1/car-details-view/SL25416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3650811e-3c90-53de-b9f5-61d048b9f7e4 with identifier: BR03332
2026-01-28 17:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3650811e-3c90-53de-b9f5-61d048b9f7e4 with scrape type 2
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3650811e-3c90-53de-b9f5-61d048b9f7e4 with scrape type 2
2026-01-28 17:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3650811e-3c90-53de-b9f5-61d048b9f7e4, identifier: BR03332
2026-01-28 17:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-01-28 17:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with scrape type 2
2026-01-28 17:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with scrape type 2
2026-01-28 17:08:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2bfe1f81-fb7d-5ed4-b080-04fc82149486, identifier: SL25416
2026-01-28 17:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3650811e-3c90-53de-b9f5-61d048b9f7e4 with identifier: BR03332
2026-01-28 17:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3650811e-3c90-53de-b9f5-61d048b9f7e4 with identifier: BR03332
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3650811e-3c90-53de-b9f5-61d048b9f7e4 spider: auto1.es
2026-01-28 17:08:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3650811e-3c90-53de-b9f5-61d048b9f7e4 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'express' containing 'express'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:44:33Z',
 'fuel_type': 'diesel',
 'id': '3650811e-3c90-53de-b9f5-61d048b9f7e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR03332',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 101120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BR03332%27 HTTP/1.1" 200 None
2026-01-28 17:08:03 [auto1.es] INFO: Saving data for BR03332: {'auction_closing_time': 1769705073.0, 'created_time': 1769101640.824867, 'last_price_update_time': 1769620083.195979}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BR03332') HTTP/1.1" 204 0
2026-01-28 17:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416
2026-01-28 17:08:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 2bfe1f81-fb7d-5ed4-b080-04fc82149486 with identifier: SL25416 to the API
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL25416>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:23Z',
 'fuel_type': 'diesel',
 'id': '2bfe1f81-fb7d-5ed4-b080-04fc82149486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL25416',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 106761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2020}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL25416%27 HTTP/1.1" 200 None
2026-01-28 17:08:03 [auto1.es] INFO: Saving data for SL25416: {'auction_closing_time': 1769703323.0, 'created_time': 1769148206.013998, 'last_price_update_time': 1769620083.510611}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL25416') HTTP/1.1" 204 0
2026-01-28 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV21475/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ38714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF79816> (referer: https://www.auto1.com/v1/car-details-view/NF79816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 with identifier: NF79816
2026-01-28 17:08:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 with scrape type 2
2026-01-28 17:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 with scrape type 2
2026-01-28 17:08:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9, identifier: NF79816
2026-01-28 17:08:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 with identifier: NF79816
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 with identifier: NF79816
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
2026-01-28 17:08:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 spider: auto1.es
2026-01-28 17:08:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8a2f3844-6e89-5505-99e0-ea73a4d1d5e9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit connect' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:19:44Z',
 'fuel_type': 'diesel',
 'id': '8a2f3844-6e89-5505-99e0-ea73a4d1d5e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF79816',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 121826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 TDCi EcoBlue 200 L1 Trend',
 'transmission': 'manual',
 'trim': '200 L1 Trend',
 'year': 2020}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NF79816%27 HTTP/1.1" 200 None
2026-01-28 17:08:03 [auto1.es] INFO: Saving data for NF79816: {'auction_closing_time': 1769703584.0, 'created_time': 1768323790.770467, 'last_price_update_time': 1769620083.948712}
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NF79816') HTTP/1.1" 204 0
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ND01122> (referer: https://www.auto1.com/v1/car-details-view/ND01122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA84402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [scrapy.extensions.logstats] INFO: Crawled 1093 pages (at 111 pages/min), scraped 295 items (at 32 items/min)
2026-01-28 17:08:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df575bd-5078-5228-86e4-389399237118 with identifier: ND01122
2026-01-28 17:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df575bd-5078-5228-86e4-389399237118 with scrape type 2
2026-01-28 17:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df575bd-5078-5228-86e4-389399237118 with scrape type 2
2026-01-28 17:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6df575bd-5078-5228-86e4-389399237118, identifier: ND01122
2026-01-28 17:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6df575bd-5078-5228-86e4-389399237118 with identifier: ND01122
2026-01-28 17:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6df575bd-5078-5228-86e4-389399237118 with identifier: ND01122
2026-01-28 17:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6df575bd-5078-5228-86e4-389399237118 with identifier: ND01122 to the API
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%276df575bd-5078-5228-86e4-389399237118%27 HTTP/1.1" 200 None
2026-01-28 17:08:04 [crawlers.pipelines.post_to_api] ERROR: auto1.es, item_id 6df575bd-5078-5228-86e4-389399237118: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Wed, 28 Jan 2026 17:08:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2026-01-28 17:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ND01122>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:02:16Z',
 'fuel_type': 'diesel',
 'id': '6df575bd-5078-5228-86e4-389399237118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND01122',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '1er',
 'odometer': 146164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2020}
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ND01122%27 HTTP/1.1" 200 None
2026-01-28 17:08:04 [auto1.es] INFO: Saving data for ND01122: {'auction_closing_time': 1769702536.0, 'created_time': 1768324086.920577, 'last_price_update_time': 1769620084.955005}
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ND01122') HTTP/1.1" 204 0
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY66255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN14393/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RM01009> (referer: https://www.auto1.com/v1/car-details-view/RM01009/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV22353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB74066> (referer: https://www.auto1.com/v1/car-details-view/AB74066/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM21267> (referer: https://www.auto1.com/v1/car-details-view/DM21267/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffeac865-654b-5631-b26f-07e118b62719 with identifier: RM01009
2026-01-28 17:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffeac865-654b-5631-b26f-07e118b62719 with scrape type 2
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffeac865-654b-5631-b26f-07e118b62719 with scrape type 2
2026-01-28 17:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ffeac865-654b-5631-b26f-07e118b62719, identifier: RM01009
2026-01-28 17:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ffeac865-654b-5631-b26f-07e118b62719 with identifier: RM01009
2026-01-28 17:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ffeac865-654b-5631-b26f-07e118b62719 with identifier: RM01009
2026-01-28 17:08:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ffeac865-654b-5631-b26f-07e118b62719 with identifier: RM01009 to the API
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RM01009>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:59:16Z',
 'fuel_type': 'diesel',
 'id': 'ffeac865-654b-5631-b26f-07e118b62719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM01009',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 131023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.5 dCi Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2020}
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RM01009%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [auto1.es] INFO: Saving data for RM01009: {'auction_closing_time': 1769705956.0, 'created_time': 1769101597.462336, 'last_price_update_time': 1769620085.464757}
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RM01009') HTTP/1.1" 204 0
2026-01-28 17:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 with identifier: AB74066
2026-01-28 17:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 with scrape type 2
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 with scrape type 2
2026-01-28 17:08:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249, identifier: AB74066
2026-01-28 17:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8086508b-4998-5df0-a304-96d3fc2af233 with identifier: DM21267
2026-01-28 17:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8086508b-4998-5df0-a304-96d3fc2af233 with scrape type 1
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_63563abfcc4ce723294f259f66080abc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_63563abfcc4ce723294f259f66080abc.jpg not downloaded yet
2026-01-28 17:08:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 with identifier: AB74066
2026-01-28 17:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 with identifier: AB74066
2026-01-28 17:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:08:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 spider: auto1.es
2026-01-28 17:08:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bfcc2004-e4c6-5e1b-8b6e-9921fcf70249 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:43:51Z',
 'fuel_type': 'diesel',
 'id': 'bfcc2004-e4c6-5e1b-8b6e-9921fcf70249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB74066',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 137450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AB74066%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [auto1.es] INFO: Saving data for AB74066: {'auction_closing_time': 1769705031.0, 'created_time': 1768323742.130789, 'last_price_update_time': 1769620085.830991}
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AB74066') HTTP/1.1" 204 0
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_94c0afade75c0f5e69867d5313fdd981.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_94c0afade75c0f5e69867d5313fdd981.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_e463f287ea5a4aa3bea9be33634cc236.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e463f287ea5a4aa3bea9be33634cc236.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_11bf97291d61e4b3762e1869faac4614.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_11bf97291d61e4b3762e1869faac4614.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg not downloaded yet
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_3f8240ae45658469e286707994bc2a93.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3f8240ae45658469e286707994bc2a93.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_814c403c09f1abb6b150562b628e0c50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_814c403c09f1abb6b150562b628e0c50.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_3c2f33b9468339a7798ae38661e96a31.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3c2f33b9468339a7798ae38661e96a31.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_66df68cffa2ab4a79eea9fd244f84359.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_66df68cffa2ab4a79eea9fd244f84359.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg not downloaded yet
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_4984f4a6e8ea25f1a8142d002f103255.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_4984f4a6e8ea25f1a8142d002f103255.jpg not downloaded yet
2026-01-28 17:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR99228> (referer: https://www.auto1.com/v1/car-details-view/XR99228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM22343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af241fc-fde5-50ad-a685-cd20c229a247 with identifier: XR99228
2026-01-28 17:08:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af241fc-fde5-50ad-a685-cd20c229a247 with scrape type 2
2026-01-28 17:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af241fc-fde5-50ad-a685-cd20c229a247 with scrape type 2
2026-01-28 17:08:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0af241fc-fde5-50ad-a685-cd20c229a247, identifier: XR99228
2026-01-28 17:08:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0af241fc-fde5-50ad-a685-cd20c229a247 with identifier: XR99228
2026-01-28 17:08:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0af241fc-fde5-50ad-a685-cd20c229a247 with identifier: XR99228
2026-01-28 17:08:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0af241fc-fde5-50ad-a685-cd20c229a247 with identifier: XR99228 to the API
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XR99228>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:33:45Z',
 'fuel_type': 'diesel',
 'id': '0af241fc-fde5-50ad-a685-cd20c229a247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR99228',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'BMW',
 'model': '3er',
 'odometer': 117498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XR99228%27 HTTP/1.1" 200 None
2026-01-28 17:08:07 [auto1.es] INFO: Saving data for XR99228: {'auction_closing_time': 1769704425.0, 'created_time': 1768298572.883948, 'last_price_update_time': 1769620087.093084}
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XR99228') HTTP/1.1" 204 0
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_4984f4a6e8ea25f1a8142d002f103255.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY15178> (referer: https://www.auto1.com/v1/car-details-view/AY15178/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL69092> (referer: https://www.auto1.com/v1/car-details-view/GL69092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ84403> (referer: https://www.auto1.com/v1/car-details-view/HZ84403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NP31534/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC11902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_66df68cffa2ab4a79eea9fd244f84359.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3f8240ae45658469e286707994bc2a93.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6356a890>
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg saved to cache
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63335810>
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_4984f4a6e8ea25f1a8142d002f103255.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_4984f4a6e8ea25f1a8142d002f103255.jpg saved to cache
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_814c403c09f1abb6b150562b628e0c50.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3c2f33b9468339a7798ae38661e96a31.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c with identifier: AY15178
2026-01-28 17:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c with scrape type 1
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_31157fec922e3b26fd8a251b54d771cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg not downloaded yet
2026-01-28 17:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e63856cb-2413-52de-b005-bc2710889041 with identifier: GL69092
2026-01-28 17:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e63856cb-2413-52de-b005-bc2710889041 with scrape type 2
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e63856cb-2413-52de-b005-bc2710889041 with scrape type 2
2026-01-28 17:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e63856cb-2413-52de-b005-bc2710889041, identifier: GL69092
2026-01-28 17:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-01-28 17:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0338dbe7-ace5-537d-81ca-ea17c7f55721 with scrape type 2
2026-01-28 17:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0338dbe7-ace5-537d-81ca-ea17c7f55721 with scrape type 2
2026-01-28 17:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0338dbe7-ace5-537d-81ca-ea17c7f55721, identifier: HZ84403
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289c910>
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg saved to cache
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a09c90>
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_66df68cffa2ab4a79eea9fd244f84359.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_66df68cffa2ab4a79eea9fd244f84359.jpg saved to cache
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62665e90>
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_3f8240ae45658469e286707994bc2a93.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3f8240ae45658469e286707994bc2a93.jpg saved to cache
2026-01-28 17:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e63856cb-2413-52de-b005-bc2710889041 with identifier: GL69092
2026-01-28 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e63856cb-2413-52de-b005-bc2710889041 with identifier: GL69092
2026-01-28 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 126868, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl69092', 'expiration_date': '2026-01-29t16:20:50z', 'origin_country_code': 'es', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e63856cb-2413-52de-b005-bc2710889041', 'current_year_diff': 8, 'age_in_months': 88, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 126868}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 88,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:20:50z',
     'fuel_type': 'petrol',
     'id': 'e63856cb-2413-52de-b005-bc2710889041',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl69092',
     'listing': 'auction',
     'location': 'es',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 126868,
     'odometer_in_km': 126868,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-09-12',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
2026-01-28 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e63856cb-2413-52de-b005-bc2710889041 spider: auto1.es
2026-01-28 17:08:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: e63856cb-2413-52de-b005-bc2710889041 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 126868, 'odometer_reading_unit': 'km', 'registration_date': '2018-09-12', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl69092', 'expiration_date': '2026-01-29t16:20:50z', 'origin_country_code': 'es', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': 'e63856cb-2413-52de-b005-bc2710889041', 'current_year_diff': 8, 'age_in_months': 88, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 126868}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 88,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:20:50z',
     'fuel_type': 'petrol',
     'id': 'e63856cb-2413-52de-b005-bc2710889041',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gl69092',
     'listing': 'auction',
     'location': 'es',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 126868,
     'odometer_in_km': 126868,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-09-12',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:20:50Z',
 'fuel_type': 'petrol',
 'id': 'e63856cb-2413-52de-b005-bc2710889041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL69092',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 126868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GL69092%27 HTTP/1.1" 200 None
2026-01-28 17:08:08 [auto1.es] INFO: Saving data for GL69092: {'auction_closing_time': 1769703650.0, 'created_time': 1767852146.131835, 'last_price_update_time': 1769620088.968068}
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GL69092') HTTP/1.1" 204 0
2026-01-28 17:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-01-28 17:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 with identifier: HZ84403
2026-01-28 17:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 160569 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160569
2026-01-28 17:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0338dbe7-ace5-537d-81ca-ea17c7f55721 spider: auto1.es
2026-01-28 17:08:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0338dbe7-ace5-537d-81ca-ea17c7f55721 due to rule: high_mileage_for_country.json, error: 160569 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    160569
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:27:43Z',
 'fuel_type': 'petrol',
 'id': '0338dbe7-ace5-537d-81ca-ea17c7f55721',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ84403',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 160569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2020}
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HZ84403%27 HTTP/1.1" 200 None
2026-01-28 17:08:09 [auto1.es] INFO: Saving data for HZ84403: {'auction_closing_time': 1769704063.0, 'created_time': 1769148211.747289, 'last_price_update_time': 1769620089.207533}
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HZ84403') HTTP/1.1" 204 0
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg not downloaded yet
2026-01-28 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ38714> (referer: https://www.auto1.com/v1/car-details-view/YJ38714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV21475> (referer: https://www.auto1.com/v1/car-details-view/DV21475/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA66568> (referer: https://www.auto1.com/v1/car-details-view/CA66568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62962750>
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg saved to cache
2026-01-28 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62866910>
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg saved to cache
2026-01-28 17:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635ef550>
2026-01-28 17:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_814c403c09f1abb6b150562b628e0c50.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_814c403c09f1abb6b150562b628e0c50.jpg saved to cache
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62621490>
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg saved to cache
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629b0490>
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_3c2f33b9468339a7798ae38661e96a31.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3c2f33b9468339a7798ae38661e96a31.jpg saved to cache
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg not downloaded yet
2026-01-28 17:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_63563abfcc4ce723294f259f66080abc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_11bf97291d61e4b3762e1869faac4614.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_94c0afade75c0f5e69867d5313fdd981.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e463f287ea5a4aa3bea9be33634cc236.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_0cacb266f8f36166d57380beb98e0676.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg not downloaded yet
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SU76295> (referer: https://www.auto1.com/v1/car-details-view/SU76295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AE99486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX97052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH74884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6369bb90>
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg saved to cache
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed285c3a-d9da-5e10-b30a-2219b5062946 with identifier: YJ38714
2026-01-28 17:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed285c3a-d9da-5e10-b30a-2219b5062946 with scrape type 1
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_e78f536c23a799f21cb01d6088eee23a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e78f536c23a799f21cb01d6088eee23a.jpg not downloaded yet
2026-01-28 17:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598d9157-fe99-5e7f-951e-40fe3d3b4063 with identifier: DV21475
2026-01-28 17:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598d9157-fe99-5e7f-951e-40fe3d3b4063 with scrape type 1
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 598d9157-fe99-5e7f-951e-40fe3d3b4063
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_6d0462dcc988b8ff7d1627a2930901d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_6d0462dcc988b8ff7d1627a2930901d3.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_2446591ee7047153ae74e123367e2044.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_2446591ee7047153ae74e123367e2044.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_8d5c5f264b80b90f1985bf152c6b5ab0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_8d5c5f264b80b90f1985bf152c6b5ab0.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_3c4fe196e3f430e401e34751b9b1c6ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_3c4fe196e3f430e401e34751b9b1c6ae.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_689382d10fb65886d282f6aa972271d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_689382d10fb65886d282f6aa972271d8.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_74a249474ba26eea9de318197a01c108.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_74a249474ba26eea9de318197a01c108.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_687d08fc083f9b5aa9d596ff7b4dacaa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_687d08fc083f9b5aa9d596ff7b4dacaa.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_fcefb0619ba22f05d0194935a4260b9c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fcefb0619ba22f05d0194935a4260b9c.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_c6555c61dcb5880105b129ce96040b94.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_c6555c61dcb5880105b129ce96040b94.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_fd413ef6e410c88ebe9b9e12aef789ba.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fd413ef6e410c88ebe9b9e12aef789ba.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_a065e6c31ab406faeff59d0db02c42a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_a065e6c31ab406faeff59d0db02c42a8.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_0398d357987cb7a3bed3adf0bbe96c2e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_0398d357987cb7a3bed3adf0bbe96c2e.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_43dc02b494f67a9e48c67dc747029bd2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_43dc02b494f67a9e48c67dc747029bd2.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_de9f9b05c9a2b80f68b1c6a5fbfa6941.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_de9f9b05c9a2b80f68b1c6a5fbfa6941.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_e79abc8de40e8aaccadea399909eb982.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_e79abc8de40e8aaccadea399909eb982.jpg already downloaded
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F5a%252F005a95bbeb6fba663f579aaa5096110e%252Fpa%252FDV21475_928ba4b246b1a404d65a991342e8f357.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_928ba4b246b1a404d65a991342e8f357.jpg already downloaded
2026-01-28 17:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 598d9157-fe99-5e7f-951e-40fe3d3b4063, identifier: DV21475
2026-01-28 17:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2026-01-28 17:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c66706bc-507e-5dfa-b78e-cd56a4201012 with scrape type 2
2026-01-28 17:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c66706bc-507e-5dfa-b78e-cd56a4201012 with scrape type 2
2026-01-28 17:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c66706bc-507e-5dfa-b78e-cd56a4201012, identifier: CA66568
2026-01-28 17:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 598d9157-fe99-5e7f-951e-40fe3d3b4063 with identifier: DV21475
2026-01-28 17:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 598d9157-fe99-5e7f-951e-40fe3d3b4063 with identifier: DV21475
2026-01-28 17:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 598d9157-fe99-5e7f-951e-40fe3d3b4063 with identifier: DV21475 to the API
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV21475>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:16:02Z',
 'fuel_type': 'diesel',
 'id': '598d9157-fe99-5e7f-951e-40fe3d3b4063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV21475',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 84690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_6d0462dcc988b8ff7d1627a2930901d3.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_2446591ee7047153ae74e123367e2044.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_8d5c5f264b80b90f1985bf152c6b5ab0.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_3c4fe196e3f430e401e34751b9b1c6ae.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_689382d10fb65886d282f6aa972271d8.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_74a249474ba26eea9de318197a01c108.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_687d08fc083f9b5aa9d596ff7b4dacaa.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fcefb0619ba22f05d0194935a4260b9c.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_c6555c61dcb5880105b129ce96040b94.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fd413ef6e410c88ebe9b9e12aef789ba.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_a065e6c31ab406faeff59d0db02c42a8.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_0398d357987cb7a3bed3adf0bbe96c2e.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_43dc02b494f67a9e48c67dc747029bd2.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_de9f9b05c9a2b80f68b1c6a5fbfa6941.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_e79abc8de40e8aaccadea399909eb982.jpg',
                'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_928ba4b246b1a404d65a991342e8f357.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115583,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_6d0462dcc988b8ff7d1627a2930901d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_2446591ee7047153ae74e123367e2044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_8d5c5f264b80b90f1985bf152c6b5ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_3c4fe196e3f430e401e34751b9b1c6ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_689382d10fb65886d282f6aa972271d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_74a249474ba26eea9de318197a01c108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_687d08fc083f9b5aa9d596ff7b4dacaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fcefb0619ba22f05d0194935a4260b9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91817,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_c6555c61dcb5880105b129ce96040b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_fd413ef6e410c88ebe9b9e12aef789ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_a065e6c31ab406faeff59d0db02c42a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87048,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_0398d357987cb7a3bed3adf0bbe96c2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_43dc02b494f67a9e48c67dc747029bd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_de9f9b05c9a2b80f68b1c6a5fbfa6941.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_e79abc8de40e8aaccadea399909eb982.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598d9157-fe99-5e7f-951e-40fe3d3b4063/598d9157-fe99-5e7f-951e-40fe3d3b4063_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/5a/005a95bbeb6fba663f579aaa5096110e/pa/DV21475_928ba4b246b1a404d65a991342e8f357.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2020}
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DV21475%27 HTTP/1.1" 200 None
2026-01-28 17:08:11 [auto1.es] INFO: Saving data for DV21475: {'created_time': 1769620091.913363, 'last_price_update_time': 1769620091.913375, 'auction_closing_time': 1769703362.0}
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DV21475') HTTP/1.1" 204 0
2026-01-28 17:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2026-01-28 17:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c66706bc-507e-5dfa-b78e-cd56a4201012 with identifier: CA66568
2026-01-28 17:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189589 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189589
2026-01-28 17:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c66706bc-507e-5dfa-b78e-cd56a4201012 spider: auto1.es
2026-01-28 17:08:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c66706bc-507e-5dfa-b78e-cd56a4201012 due to rule: high_mileage_for_country.json, error: 189589 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189589
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:57:27Z',
 'fuel_type': 'diesel',
 'id': 'c66706bc-507e-5dfa-b78e-cd56a4201012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA66568',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi GT Line',
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CA66568%27 HTTP/1.1" 200 None
2026-01-28 17:08:12 [auto1.es] INFO: Saving data for CA66568: {'auction_closing_time': 1769705847.0, 'created_time': 1767703581.038679, 'last_price_update_time': 1769620092.168711}
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CA66568') HTTP/1.1" 204 0
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg not downloaded yet
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg not downloaded yet
2026-01-28 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a14150>
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_63563abfcc4ce723294f259f66080abc.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_63563abfcc4ce723294f259f66080abc.jpg saved to cache
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62651f50>
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_11bf97291d61e4b3762e1869faac4614.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_11bf97291d61e4b3762e1869faac4614.jpg saved to cache
2026-01-28 17:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62650050>
2026-01-28 17:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_94c0afade75c0f5e69867d5313fdd981.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_94c0afade75c0f5e69867d5313fdd981.jpg saved to cache
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b1310>
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg saved to cache
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62877b10>
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252F83%252Fa2836778fb21fe21f6b53c453752a4d8%252Fpa%252FDM21267_e463f287ea5a4aa3bea9be33634cc236.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e463f287ea5a4aa3bea9be33634cc236.jpg saved to cache
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8086508b-4998-5df0-a304-96d3fc2af233
2026-01-28 17:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8086508b-4998-5df0-a304-96d3fc2af233, skipping ID generation
2026-01-28 17:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8086508b-4998-5df0-a304-96d3fc2af233 with scrape type 1
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8086508b-4998-5df0-a304-96d3fc2af233 from tracking dictionaries
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8086508b-4998-5df0-a304-96d3fc2af233 sending to next pipeline
2026-01-28 17:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8086508b-4998-5df0-a304-96d3fc2af233, identifier: DM21267
2026-01-28 17:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2026-01-28 17:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2141f0-e446-56ba-ab60-abd2b1010560 with scrape type 2
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb2141f0-e446-56ba-ab60-abd2b1010560 with scrape type 2
2026-01-28 17:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: cb2141f0-e446-56ba-ab60-abd2b1010560, identifier: SU76295
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_610257c07d299998ea5291f56b72059e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg not downloaded yet
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_df41693b80d33064ca8ab982158ad7e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_df41693b80d33064ca8ab982158ad7e3.jpg not downloaded yet
2026-01-28 17:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL50426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8086508b-4998-5df0-a304-96d3fc2af233 with identifier: DM21267
2026-01-28 17:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8086508b-4998-5df0-a304-96d3fc2af233 with identifier: DM21267
2026-01-28 17:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8086508b-4998-5df0-a304-96d3fc2af233 with identifier: DM21267 to the API
2026-01-28 17:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e463f287ea5a4aa3bea9be33634cc236.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 91,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:00:51Z',
 'fuel_type': 'diesel',
 'id': '8086508b-4998-5df0-a304-96d3fc2af233',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM21267',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 61342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_63563abfcc4ce723294f259f66080abc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_94c0afade75c0f5e69867d5313fdd981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e463f287ea5a4aa3bea9be33634cc236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_11bf97291d61e4b3762e1869faac4614.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_7ea72db28c349b5ec1d97af41c6a8633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_6ad8b47b109d03a1baf4a86e487eb404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_1e24f3cce0451c3b07dc8f8e9bdedbeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d455b2b04a2a4704cd7bb37717587d9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3f8240ae45658469e286707994bc2a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_814c403c09f1abb6b150562b628e0c50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_e5cd1aa8bbb0552d057c815f63104fb6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_d2a9c99d1d1bae1cfde5e0d0d729ac6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_3c2f33b9468339a7798ae38661e96a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_66df68cffa2ab4a79eea9fd244f84359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_b7dc269f1c3c9f3bfb66c0429ad3bb40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8086508b-4998-5df0-a304-96d3fc2af233/8086508b-4998-5df0-a304-96d3fc2af233_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/83/a2836778fb21fe21f6b53c453752a4d8/pa/DM21267_4984f4a6e8ea25f1a8142d002f103255.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM21267%27 HTTP/1.1" 200 None
2026-01-28 17:08:14 [auto1.es] INFO: Saving data for DM21267: {'created_time': 1769620094.177145, 'last_price_update_time': 1769620094.177156, 'auction_closing_time': 1769702451.0}
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM21267') HTTP/1.1" 204 0
2026-01-28 17:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2026-01-28 17:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: cb2141f0-e446-56ba-ab60-abd2b1010560 with identifier: SU76295
2026-01-28 17:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: cb2141f0-e446-56ba-ab60-abd2b1010560 spider: auto1.es
2026-01-28 17:08:14 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: cb2141f0-e446-56ba-ab60-abd2b1010560 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:08:29Z',
 'fuel_type': 'diesel',
 'id': 'cb2141f0-e446-56ba-ab60-abd2b1010560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU76295',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 117897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU76295%27 HTTP/1.1" 200 None
2026-01-28 17:08:14 [auto1.es] INFO: Saving data for SU76295: {'auction_closing_time': 1769702909.0, 'created_time': 1768237584.003129, 'last_price_update_time': 1769620094.408955}
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SU76295') HTTP/1.1" 204 0
2026-01-28 17:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_07e39be48970e1f8b08586546bcf4c32.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg not downloaded yet
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg not downloaded yet
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6276dc90>
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_31157fec922e3b26fd8a251b54d771cf.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg saved to cache
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62ae5fd0>
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg saved to cache
2026-01-28 17:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_17b3ce58d3060551c02f32ab0afe0145.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg not downloaded yet
2026-01-28 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e78f536c23a799f21cb01d6088eee23a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a03750>
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg saved to cache
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_33ef8d0e6791d1189e137a01a3032887.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg not downloaded yet
2026-01-28 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_df41693b80d33064ca8ab982158ad7e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_dd582612e87f83a5732545862adeac55.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_86e9dafd9834644077f90ebce3021f51.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_86e9dafd9834644077f90ebce3021f51.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg not downloaded yet
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a92890>
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_e78f536c23a799f21cb01d6088eee23a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e78f536c23a799f21cb01d6088eee23a.jpg saved to cache
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_7d5a6775cee990e01c07e53434cf82c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg not downloaded yet
2026-01-28 17:08:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_88618bd5faed7dc77516b8114c8042b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_cb3725d1073b453f41ab4222912c3c20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_cb3725d1073b453f41ab4222912c3c20.jpg not downloaded yet
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62737210>
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_df41693b80d33064ca8ab982158ad7e3.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_df41693b80d33064ca8ab982158ad7e3.jpg saved to cache
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_222c159de2a109f38e771d233f9361ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_c043483b741c3d5fea44fe585125f334.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c043483b741c3d5fea44fe585125f334.jpg not downloaded yet
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg not downloaded yet
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg not downloaded yet
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62635c50>
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg saved to cache
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_cdca13368d4e9463c93be156d7227415.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg not downloaded yet
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg not downloaded yet
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg not downloaded yet
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC11902> (referer: https://www.auto1.com/v1/car-details-view/YC11902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NP31534> (referer: https://www.auto1.com/v1/car-details-view/NP31534/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM22343> (referer: https://www.auto1.com/v1/car-details-view/LM22343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg not downloaded yet
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_606c93cc47101caef5ee819a7241008c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_606c93cc47101caef5ee819a7241008c.jpg not downloaded yet
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f6d90>
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg saved to cache
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_606c93cc47101caef5ee819a7241008c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY66255> (referer: https://www.auto1.com/v1/car-details-view/HY66255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN14393> (referer: https://www.auto1.com/v1/car-details-view/NN14393/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with identifier: YC11902
2026-01-28 17:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with scrape type 1
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_803bec5a0b71ff08137fbf105762ebdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_803bec5a0b71ff08137fbf105762ebdd.jpg not downloaded yet
2026-01-28 17:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a16794d2-8349-5e08-bc33-d940c6f7bf07 with identifier: NP31534
2026-01-28 17:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16794d2-8349-5e08-bc33-d940c6f7bf07 with scrape type 1
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_9f12a828c75aac0eb46171144e694c26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_9f12a828c75aac0eb46171144e694c26.jpg not downloaded yet
2026-01-28 17:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aef7cfe1-a898-5747-ae26-10b7a4775084 with identifier: LM22343
2026-01-28 17:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef7cfe1-a898-5747-ae26-10b7a4775084 with scrape type 1
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg not downloaded yet
2026-01-28 17:08:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62694910>
2026-01-28 17:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_0cacb266f8f36166d57380beb98e0676.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg saved to cache
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_0e6f25d707260ebb534f3886205f07a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_0e6f25d707260ebb534f3886205f07a5.jpg not downloaded yet
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg not downloaded yet
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_c5c130ce585028b2036f91fa22b15801.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_c5c130ce585028b2036f91fa22b15801.jpg not downloaded yet
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6331c910>
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg saved to cache
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628a36d0>
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg saved to cache
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627b0ed0>
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg saved to cache
2026-01-28 17:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288a210>
2026-01-28 17:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_cdca13368d4e9463c93be156d7227415.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg saved to cache
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627b3fd0>
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_606c93cc47101caef5ee819a7241008c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_606c93cc47101caef5ee819a7241008c.jpg saved to cache
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 175e63bf-3180-5ee0-b5e2-e40e2dfaa711 with identifier: HY66255
2026-01-28 17:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 175e63bf-3180-5ee0-b5e2-e40e2dfaa711 with scrape type 1
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 175e63bf-3180-5ee0-b5e2-e40e2dfaa711
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_bb449664a862e115888a50c7cb4f2aba.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_bb449664a862e115888a50c7cb4f2aba.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_2feaede296faaf7bfcda7aed48a871ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_2feaede296faaf7bfcda7aed48a871ef.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_c5814e8ae639418b4058cdd039db2295.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c5814e8ae639418b4058cdd039db2295.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_aaf01a1294b485e08a26f004fe9ddac1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_aaf01a1294b485e08a26f004fe9ddac1.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_a49115c5a4dde28df41410c852e3c297.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_a49115c5a4dde28df41410c852e3c297.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_58f3a281f1f3117323f9cc74d438f596.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_58f3a281f1f3117323f9cc74d438f596.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_f954ef196943ff873ec4a067e9a1214d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_f954ef196943ff873ec4a067e9a1214d.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_7ae1c594399839ddb5ec20226e79fc10.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_7ae1c594399839ddb5ec20226e79fc10.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_96b3853c92e74a03b9451231eefffcaf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_96b3853c92e74a03b9451231eefffcaf.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_77a7f524fe41e2d9c74f0084892468d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_77a7f524fe41e2d9c74f0084892468d6.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_c0a3c303fc4e74bc5eef39403a07fe25.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c0a3c303fc4e74bc5eef39403a07fe25.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_d0428350850faa9329589e73121a734b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_d0428350850faa9329589e73121a734b.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_6cd59ce04115c28cb7086de11a97381f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_6cd59ce04115c28cb7086de11a97381f.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_9efcb685983641742f33b9b5874f979b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_9efcb685983641742f33b9b5874f979b.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_60c15c7f4fa0faf1e7d63b754f158d25.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_60c15c7f4fa0faf1e7d63b754f158d25.jpg already downloaded
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F29%252Fe72992d8695f605a152704e4ce6fe8ed%252Fpa%252FHY66255_94d8007f66bfb0adf60fa5c47dab4621.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_94d8007f66bfb0adf60fa5c47dab4621.jpg already downloaded
2026-01-28 17:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 175e63bf-3180-5ee0-b5e2-e40e2dfaa711, identifier: HY66255
2026-01-28 17:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad with identifier: NN14393
2026-01-28 17:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad with scrape type 1
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg not downloaded yet
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_673ff7a40d1328337dea599f29512fc6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_673ff7a40d1328337dea599f29512fc6.jpg not downloaded yet
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg not downloaded yet
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg not downloaded yet
2026-01-28 17:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 175e63bf-3180-5ee0-b5e2-e40e2dfaa711 with identifier: HY66255
2026-01-28 17:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 175e63bf-3180-5ee0-b5e2-e40e2dfaa711 with identifier: HY66255
2026-01-28 17:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 175e63bf-3180-5ee0-b5e2-e40e2dfaa711 with identifier: HY66255 to the API
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HY66255>
{'auction_title': '',
 'c_o_2_emission_value': 46,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 188,
 'expiration_date': '2026-01-29T16:50:16Z',
 'fuel_type': 'hybrid',
 'id': '175e63bf-3180-5ee0-b5e2-e40e2dfaa711',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY66255',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 98513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_bb449664a862e115888a50c7cb4f2aba.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_2feaede296faaf7bfcda7aed48a871ef.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c5814e8ae639418b4058cdd039db2295.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_aaf01a1294b485e08a26f004fe9ddac1.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_a49115c5a4dde28df41410c852e3c297.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_58f3a281f1f3117323f9cc74d438f596.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_f954ef196943ff873ec4a067e9a1214d.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_7ae1c594399839ddb5ec20226e79fc10.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_96b3853c92e74a03b9451231eefffcaf.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_77a7f524fe41e2d9c74f0084892468d6.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c0a3c303fc4e74bc5eef39403a07fe25.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_d0428350850faa9329589e73121a734b.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_6cd59ce04115c28cb7086de11a97381f.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_9efcb685983641742f33b9b5874f979b.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_60c15c7f4fa0faf1e7d63b754f158d25.jpg',
                'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_94d8007f66bfb0adf60fa5c47dab4621.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_bb449664a862e115888a50c7cb4f2aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_2feaede296faaf7bfcda7aed48a871ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c5814e8ae639418b4058cdd039db2295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_aaf01a1294b485e08a26f004fe9ddac1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_a49115c5a4dde28df41410c852e3c297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_58f3a281f1f3117323f9cc74d438f596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_f954ef196943ff873ec4a067e9a1214d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_7ae1c594399839ddb5ec20226e79fc10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_96b3853c92e74a03b9451231eefffcaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_77a7f524fe41e2d9c74f0084892468d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_c0a3c303fc4e74bc5eef39403a07fe25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_d0428350850faa9329589e73121a734b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_6cd59ce04115c28cb7086de11a97381f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48528,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_9efcb685983641742f33b9b5874f979b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_60c15c7f4fa0faf1e7d63b754f158d25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_175e63bf-3180-5ee0-b5e2-e40e2dfaa711/175e63bf-3180-5ee0-b5e2-e40e2dfaa711_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/29/e72992d8695f605a152704e4ce6fe8ed/pa/HY66255_94d8007f66bfb0adf60fa5c47dab4621.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Motion 4WD',
 'transmission': 'automatic',
 'trim': 'Motion 4WD',
 'year': 2022}
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HY66255%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [auto1.es] INFO: Saving data for HY66255: {'created_time': 1769620099.230707, 'last_price_update_time': 1769620099.230717, 'auction_closing_time': 1769705416.0}
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HY66255') HTTP/1.1" 204 0
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_fb666813d77efe4d99bee2b1592487ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_fb666813d77efe4d99bee2b1592487ea.jpg not downloaded yet
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_cb3725d1073b453f41ab4222912c3c20.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg not downloaded yet
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg not downloaded yet
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg not downloaded yet
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU48427> (referer: https://www.auto1.com/v1/car-details-view/TU48427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR26127/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU95928> (referer: https://www.auto1.com/v1/car-details-view/WU95928/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA84402> (referer: https://www.auto1.com/v1/car-details-view/HA84402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV22353> (referer: https://www.auto1.com/v1/car-details-view/HV22353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e5390>
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg saved to cache
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63477ad0>
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg saved to cache
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_2c735a50384ec177b04afbc21b1780a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_2c735a50384ec177b04afbc21b1780a9.jpg not downloaded yet
2026-01-28 17:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_baf3234ee84bf41634666e8b92b46e75.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_baf3234ee84bf41634666e8b92b46e75.jpg not downloaded yet
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg not downloaded yet
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg not downloaded yet
2026-01-28 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_9f12a828c75aac0eb46171144e694c26.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg not downloaded yet
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6273c910>
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_88618bd5faed7dc77516b8114c8042b2.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg saved to cache
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6334ee90>
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_222c159de2a109f38e771d233f9361ab.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg saved to cache
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628dcdd0>
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg saved to cache
2026-01-28 17:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62986b90>
2026-01-28 17:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_cb3725d1073b453f41ab4222912c3c20.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_cb3725d1073b453f41ab4222912c3c20.jpg saved to cache
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229c628d-f34c-5cc3-96db-9c87efc96f7e with identifier: TU48427
2026-01-28 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229c628d-f34c-5cc3-96db-9c87efc96f7e with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229c628d-f34c-5cc3-96db-9c87efc96f7e with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 229c628d-f34c-5cc3-96db-9c87efc96f7e, identifier: TU48427
2026-01-28 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d76b3151-26fe-5a4f-89c9-5675fe3f4511 with identifier: WU95928
2026-01-28 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d76b3151-26fe-5a4f-89c9-5675fe3f4511 with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d76b3151-26fe-5a4f-89c9-5675fe3f4511 with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d76b3151-26fe-5a4f-89c9-5675fe3f4511, identifier: WU95928
2026-01-28 17:08:21 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 183222fb-2b0d-575e-b134-9aad130c0e24 with identifier: HA84402
2026-01-28 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 183222fb-2b0d-575e-b134-9aad130c0e24 with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 183222fb-2b0d-575e-b134-9aad130c0e24 with scrape type 2
2026-01-28 17:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 183222fb-2b0d-575e-b134-9aad130c0e24, identifier: HA84402
2026-01-28 17:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d23f277-1273-5d07-a9dd-b2a8364e977d with identifier: HV22353
2026-01-28 17:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d23f277-1273-5d07-a9dd-b2a8364e977d with scrape type 1
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_37f8e36a1e1e69234549e21106c66d3c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_37f8e36a1e1e69234549e21106c66d3c.jpg not downloaded yet
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg not downloaded yet
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg not downloaded yet
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_7877a732dac7bfe879fc1ddc084706da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7877a732dac7bfe879fc1ddc084706da.jpg not downloaded yet
2026-01-28 17:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 229c628d-f34c-5cc3-96db-9c87efc96f7e with identifier: TU48427
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 229c628d-f34c-5cc3-96db-9c87efc96f7e with identifier: TU48427
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 229c628d-f34c-5cc3-96db-9c87efc96f7e spider: auto1.es
2026-01-28 17:08:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 229c628d-f34c-5cc3-96db-9c87efc96f7e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:53:04Z',
 'fuel_type': 'diesel',
 'id': '229c628d-f34c-5cc3-96db-9c87efc96f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU48427',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 113235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-01',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'manual',
 'trim': 'Club M',
 'year': 2022}
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TU48427%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [auto1.es] INFO: Saving data for TU48427: {'auction_closing_time': 1769705584.0, 'created_time': 1768401908.294509, 'last_price_update_time': 1769620101.705118}
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TU48427') HTTP/1.1" 204 0
2026-01-28 17:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d76b3151-26fe-5a4f-89c9-5675fe3f4511 with identifier: WU95928
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d76b3151-26fe-5a4f-89c9-5675fe3f4511 with identifier: WU95928
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 126472, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu95928', 'expiration_date': '2026-01-29t16:52:37z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': 'd76b3151-26fe-5a4f-89c9-5675fe3f4511', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 126472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:52:37z',
     'fuel_type': 'electro',
     'id': 'd76b3151-26fe-5a4f-89c9-5675fe3f4511',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu95928',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 126472,
     'odometer_in_km': 126472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: d76b3151-26fe-5a4f-89c9-5675fe3f4511 spider: auto1.es
2026-01-28 17:08:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d76b3151-26fe-5a4f-89c9-5675fe3f4511 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 126472, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu95928', 'expiration_date': '2026-01-29t16:52:37z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 3, 'c_o_2_emission_value': None, 'id': 'd76b3151-26fe-5a4f-89c9-5675fe3f4511', 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 126472}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 43,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:52:37z',
     'fuel_type': 'electro',
     'id': 'd76b3151-26fe-5a4f-89c9-5675fe3f4511',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/wu95928',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 126472,
     'odometer_in_km': 126472,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-06-26',
     'sanitized_make': 'maxus',
     'seats_number': 3,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:52:37Z',
 'fuel_type': 'electro',
 'id': 'd76b3151-26fe-5a4f-89c9-5675fe3f4511',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU95928',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 126472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WU95928%27 HTTP/1.1" 200 None
2026-01-28 17:08:21 [auto1.es] INFO: Saving data for WU95928: {'auction_closing_time': 1769705557.0, 'created_time': 1768401657.069203, 'last_price_update_time': 1769620101.956999}
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WU95928') HTTP/1.1" 204 0
2026-01-28 17:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 183222fb-2b0d-575e-b134-9aad130c0e24 with identifier: HA84402
2026-01-28 17:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 183222fb-2b0d-575e-b134-9aad130c0e24 with identifier: HA84402
2026-01-28 17:08:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 183222fb-2b0d-575e-b134-9aad130c0e24 with identifier: HA84402 to the API
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HA84402>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:25:19Z',
 'fuel_type': 'petrol',
 'id': '183222fb-2b0d-575e-b134-9aad130c0e24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA84402',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 74219,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HA84402%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Saving data for HA84402: {'auction_closing_time': 1769703919.0, 'created_time': 1768401831.791838, 'last_price_update_time': 1769620102.345308}
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HA84402') HTTP/1.1" 204 0
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_673ff7a40d1328337dea599f29512fc6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg not downloaded yet
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: AS88754
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AS88754%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for AS88754: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: ZD50778
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD50778%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for ZD50778: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: UT52372
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT52372%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for UT52372: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: GW05741
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GW05741%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for GW05741: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: MG50148
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MG50148%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for MG50148: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: EY99045
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY99045%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for EY99045: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: JS62552
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JS62552%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for JS62552: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: MB07340
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB07340%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for MB07340: 2
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg not downloaded yet
2026-01-28 17:08:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_fb666813d77efe4d99bee2b1592487ea.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg not downloaded yet
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_be31beb80787acd961fd458f554396d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_be31beb80787acd961fd458f554396d8.jpg not downloaded yet
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg not downloaded yet
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY58964/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH74884> (referer: https://www.auto1.com/v1/car-details-view/CH74884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_c5c130ce585028b2036f91fa22b15801.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_1e6b40abe6025a7decf3e21bd59df652.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_1e6b40abe6025a7decf3e21bd59df652.jpg not downloaded yet
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: NT91356
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NT91356%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for NT91356: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: YN68202
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YN68202%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for YN68202: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: YA70730
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA70730%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for YA70730: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: SU69829
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SU69829%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for SU69829: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: WF99356
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WF99356%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for WF99356: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: YA06630
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA06630%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for YA06630: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: XH60546
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XH60546%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for XH60546: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: GV99181
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV99181%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for GV99181: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: GS13880
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GS13880%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for GS13880: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: NM62310
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM62310%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for NM62310: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: ZP66767
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZP66767%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for ZP66767: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: XV04489
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XV04489%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for XV04489: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: SE18211
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SE18211%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for SE18211: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: DT57458
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DT57458%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for DT57458: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: RF90830
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RF90830%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for RF90830: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: LN42337
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LN42337%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for LN42337: 0
2026-01-28 17:08:22 [auto1.es] INFO: Found listing with ID: BE48762
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE48762%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [auto1.es] INFO: Scrape type for BE48762: 2
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_a5e5b5e885b221991d0625d395591910.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_a5e5b5e885b221991d0625d395591910.jpg not downloaded yet
2026-01-28 17:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_339cc6b8310d07fbcea383360ddec61d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_339cc6b8310d07fbcea383360ddec61d.jpg not downloaded yet
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_2064d85f466cbc0785f27d884b308887.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_2064d85f466cbc0785f27d884b308887.jpg not downloaded yet
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg not downloaded yet
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62813250>
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_9f12a828c75aac0eb46171144e694c26.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_9f12a828c75aac0eb46171144e694c26.jpg saved to cache
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6341b610>
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg saved to cache
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6261ded0>
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_673ff7a40d1328337dea599f29512fc6.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_673ff7a40d1328337dea599f29512fc6.jpg saved to cache
2026-01-28 17:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260c810>
2026-01-28 17:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg saved to cache
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_803bec5a0b71ff08137fbf105762ebdd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_c8e30031bfb9acf66441527b722c518d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c8e30031bfb9acf66441527b722c518d.jpg not downloaded yet
2026-01-28 17:08:24 [auto1.es] INFO: Found listing with ID: ME67381
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME67381%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [auto1.es] INFO: Scrape type for ME67381: 2
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg not downloaded yet
2026-01-28 17:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_0e6f25d707260ebb534f3886205f07a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_2c735a50384ec177b04afbc21b1780a9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg not downloaded yet
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ca6ae4ac56167c16425f2284521fb31a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca6ae4ac56167c16425f2284521fb31a.jpg not downloaded yet
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_8d51ba1218b5589355f5e6a645937886.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8d51ba1218b5589355f5e6a645937886.jpg not downloaded yet
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_c7c02121dce294cff1ec614d955ee45e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c7c02121dce294cff1ec614d955ee45e.jpg not downloaded yet
2026-01-28 17:08:24 [auto1.es] INFO: Found listing with ID: UP80537
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80537%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [auto1.es] INFO: Scrape type for UP80537: 2
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_4018187b50ee0106e3932ebbf488efa0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_4018187b50ee0106e3932ebbf488efa0.jpg not downloaded yet
2026-01-28 17:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636400d0>
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg saved to cache
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344ed10>
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg saved to cache
2026-01-28 17:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293dbd0>
2026-01-28 17:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_fb666813d77efe4d99bee2b1592487ea.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_fb666813d77efe4d99bee2b1592487ea.jpg saved to cache
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b with identifier: CH74884
2026-01-28 17:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b with scrape type 1
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_2468ed476a36fade67cb8fedf4829dab.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2468ed476a36fade67cb8fedf4829dab.jpg not downloaded yet
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a6a190>
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_c5c130ce585028b2036f91fa22b15801.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_c5c130ce585028b2036f91fa22b15801.jpg saved to cache
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62544910>
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg saved to cache
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_37f8e36a1e1e69234549e21106c66d3c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_e154b6512201b5145a9432e1e087e5f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_e154b6512201b5145a9432e1e087e5f2.jpg not downloaded yet
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg not downloaded yet
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_f6774285b94bf5d4badffce4a9bebf58.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f6774285b94bf5d4badffce4a9bebf58.jpg not downloaded yet
2026-01-28 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7877a732dac7bfe879fc1ddc084706da.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg not downloaded yet
2026-01-28 17:08:25 [auto1.es] INFO: Found listing with ID: DN99031
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DN99031%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [auto1.es] INFO: Scrape type for DN99031: 0
2026-01-28 17:08:25 [auto1.es] INFO: Found listing with ID: YJ21856
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ21856%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [auto1.es] INFO: Scrape type for YJ21856: 2
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_f43f67e586d6261f677ed9917946532f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_f43f67e586d6261f677ed9917946532f.jpg not downloaded yet
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg not downloaded yet
2026-01-28 17:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62964f50>
2026-01-28 17:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg saved to cache
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636dff50>
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_803bec5a0b71ff08137fbf105762ebdd.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_803bec5a0b71ff08137fbf105762ebdd.jpg saved to cache
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg not downloaded yet
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg not downloaded yet
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg not downloaded yet
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63336c90>
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_0e6f25d707260ebb534f3886205f07a5.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_0e6f25d707260ebb534f3886205f07a5.jpg saved to cache
2026-01-28 17:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6255d750>
2026-01-28 17:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_7d5a6775cee990e01c07e53434cf82c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg saved to cache
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6342c750>
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_2c735a50384ec177b04afbc21b1780a9.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_2c735a50384ec177b04afbc21b1780a9.jpg saved to cache
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_be31beb80787acd961fd458f554396d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg not downloaded yet
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: SK27491
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK27491%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for SK27491: 0
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: KK12826
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK12826%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for KK12826: 0
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: BD44007
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BD44007%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for BD44007: 0
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: RX82607
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RX82607%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for RX82607: 0
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: BJ75970
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BJ75970%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for BJ75970: 0
2026-01-28 17:08:27 [auto1.es] INFO: Found listing with ID: GV12563
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV12563%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [auto1.es] INFO: Scrape type for GV12563: 2
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg not downloaded yet
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_1a4138beaf154d4075fabf060673578a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_1a4138beaf154d4075fabf060673578a.jpg not downloaded yet
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_72fc86e113bc6ead350be8dc8086aa23.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_72fc86e113bc6ead350be8dc8086aa23.jpg not downloaded yet
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg not downloaded yet
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_3f862a41674ca425b4b12a0171f137b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_3f862a41674ca425b4b12a0171f137b0.jpg not downloaded yet
2026-01-28 17:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a94590>
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_37f8e36a1e1e69234549e21106c66d3c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_37f8e36a1e1e69234549e21106c66d3c.jpg saved to cache
2026-01-28 17:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627e5ed0>
2026-01-28 17:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg saved to cache
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627e7a10>
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_7877a732dac7bfe879fc1ddc084706da.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7877a732dac7bfe879fc1ddc084706da.jpg saved to cache
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c8e30031bfb9acf66441527b722c518d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_a5e5b5e885b221991d0625d395591910.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg not downloaded yet
2026-01-28 17:08:28 [auto1.es] INFO: Found listing with ID: HE21672
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HE21672%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [auto1.es] INFO: Scrape type for HE21672: 0
2026-01-28 17:08:28 [auto1.es] INFO: Found listing with ID: EE15765
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE15765%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [auto1.es] INFO: Scrape type for EE15765: 0
2026-01-28 17:08:28 [auto1.es] INFO: Found listing with ID: NR83625
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR83625%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [auto1.es] INFO: Scrape type for NR83625: 0
2026-01-28 17:08:28 [auto1.es] INFO: Found listing with ID: KR69739
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR69739%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [auto1.es] INFO: Scrape type for KR69739: 2
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_031be2fa6eb1866e65f3caff20539a75.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_031be2fa6eb1866e65f3caff20539a75.jpg not downloaded yet
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_3c9432a65d9a2ab43206debb6b339958.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_3c9432a65d9a2ab43206debb6b339958.jpg not downloaded yet
2026-01-28 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL50426> (referer: https://www.auto1.com/v1/car-details-view/AL50426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_b1793441685c1fd27d3965efecdc4f71.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_b1793441685c1fd27d3965efecdc4f71.jpg not downloaded yet
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_17cff129a4f44e65389a9374195b3771.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_17cff129a4f44e65389a9374195b3771.jpg not downloaded yet
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_4282721c5a2904058351f59b26d19662.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_4282721c5a2904058351f59b26d19662.jpg not downloaded yet
2026-01-28 17:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f6774285b94bf5d4badffce4a9bebf58.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_f72812b8d5a03d856fd66e3384e04133.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f72812b8d5a03d856fd66e3384e04133.jpg not downloaded yet
2026-01-28 17:08:28 [auto1.es] INFO: Found listing with ID: ZW51113
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW51113%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [auto1.es] INFO: Scrape type for ZW51113: 2
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_c789416fc0db8bf802764fc635ed5507.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_c789416fc0db8bf802764fc635ed5507.jpg not downloaded yet
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_d6378d24dd10490b39bad84c86fd10ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_d6378d24dd10490b39bad84c86fd10ed.jpg not downloaded yet
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a0c190>
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg saved to cache
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291e510>
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg saved to cache
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63491d10>
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg saved to cache
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290e110>
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_be31beb80787acd961fd458f554396d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_be31beb80787acd961fd458f554396d8.jpg saved to cache
2026-01-28 17:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62866b90>
2026-01-28 17:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg saved to cache
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6291d4d0>
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg saved to cache
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:30 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2468ed476a36fade67cb8fedf4829dab.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg not downloaded yet
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_38f9c802501512ef682d178faa957471.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_38f9c802501512ef682d178faa957471.jpg not downloaded yet
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_aa286105cbba46a72a632246fcbcba45.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_aa286105cbba46a72a632246fcbcba45.jpg not downloaded yet
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8d51ba1218b5589355f5e6a645937886.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_803e3a17746357ecd8f1dc488208a9a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_803e3a17746357ecd8f1dc488208a9a2.jpg not downloaded yet
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_ece5016171cf561885094ab5b2916aef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ece5016171cf561885094ab5b2916aef.jpg not downloaded yet
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg not downloaded yet
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: KK01893
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KK01893%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for KK01893: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: TP66623
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP66623%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for TP66623: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: CV43839
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CV43839%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for CV43839: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: NE64974
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE64974%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for NE64974: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: XZ85086
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XZ85086%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for XZ85086: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: BG65437
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG65437%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for BG65437: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: TL18663
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TL18663%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for TL18663: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: GF81811
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GF81811%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for GF81811: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: EZ00627
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EZ00627%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for EZ00627: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: ZL85461
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL85461%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for ZL85461: 0
2026-01-28 17:08:30 [auto1.es] INFO: Found listing with ID: XD38373
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD38373%27 HTTP/1.1" 200 None
2026-01-28 17:08:30 [auto1.es] INFO: Scrape type for XD38373: 2
2026-01-28 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344e690>
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_c8e30031bfb9acf66441527b722c518d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c8e30031bfb9acf66441527b722c518d.jpg saved to cache
2026-01-28 17:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b5a50>
2026-01-28 17:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_a5e5b5e885b221991d0625d395591910.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_a5e5b5e885b221991d0625d395591910.jpg saved to cache
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_2898f89cb2ee2bfc73e33436a220555a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2898f89cb2ee2bfc73e33436a220555a.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg not downloaded yet
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY58964> (referer: https://www.auto1.com/v1/car-details-view/EY58964/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with identifier: AL50426
2026-01-28 17:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with scrape type 1
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_eb1fec7577095a1627339789c3a3128b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_eb1fec7577095a1627339789c3a3128b.jpg not downloaded yet
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633b7fd0>
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_f6774285b94bf5d4badffce4a9bebf58.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f6774285b94bf5d4badffce4a9bebf58.jpg saved to cache
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_721dc791957a3655b69773b02823822c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_721dc791957a3655b69773b02823822c.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_aefc54a5828e35885bf5b73a7196fe29.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_aefc54a5828e35885bf5b73a7196fe29.jpg not downloaded yet
2026-01-28 17:08:31 [auto1.es] INFO: Found listing with ID: FM61174
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FM61174%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [auto1.es] INFO: Scrape type for FM61174: 0
2026-01-28 17:08:31 [auto1.es] INFO: Found listing with ID: UG89519
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG89519%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [auto1.es] INFO: Scrape type for UG89519: 0
2026-01-28 17:08:31 [auto1.es] INFO: Found listing with ID: US94086
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US94086%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [auto1.es] INFO: Scrape type for US94086: 0
2026-01-28 17:08:31 [auto1.es] INFO: Found listing with ID: FB84319
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FB84319%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [auto1.es] INFO: Scrape type for FB84319: 0
2026-01-28 17:08:31 [auto1.es] INFO: Found listing with ID: HH63852
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH63852%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [auto1.es] INFO: Scrape type for HH63852: 2
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_4282721c5a2904058351f59b26d19662.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_17cff129a4f44e65389a9374195b3771.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_3c9432a65d9a2ab43206debb6b339958.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_1a4138beaf154d4075fabf060673578a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_f43f67e586d6261f677ed9917946532f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_d1be7f7a4b43d5046571401d2b726a75.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_d1be7f7a4b43d5046571401d2b726a75.jpg not downloaded yet
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_98611a3b59206850d3bdbcebfefd84a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_98611a3b59206850d3bdbcebfefd84a5.jpg not downloaded yet
2026-01-28 17:08:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62987ad0>
2026-01-28 17:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg saved to cache
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6276d790>
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_2468ed476a36fade67cb8fedf4829dab.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2468ed476a36fade67cb8fedf4829dab.jpg saved to cache
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62987f90>
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg saved to cache
2026-01-28 17:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63491d10>
2026-01-28 17:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg saved to cache
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357b650>
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_8d51ba1218b5589355f5e6a645937886.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8d51ba1218b5589355f5e6a645937886.jpg saved to cache
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62963010>
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg saved to cache
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_031be2fa6eb1866e65f3caff20539a75.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_14048e20cd7c2b347283d7bbf222786f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_14048e20cd7c2b347283d7bbf222786f.jpg not downloaded yet
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg not downloaded yet
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_2ef93480324e5f61730b07c27191739d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2ef93480324e5f61730b07c27191739d.jpg not downloaded yet
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: TB29205
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TB29205%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for TB29205: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: CP17401
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CP17401%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for CP17401: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: GN19670
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN19670%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for GN19670: 2
2026-01-28 17:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_cad7606c0f3a4f73ead3d1f156512397.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_cad7606c0f3a4f73ead3d1f156512397.jpg not downloaded yet
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_9d524479fb8d8372e394618e1d22c050.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_9d524479fb8d8372e394618e1d22c050.jpg not downloaded yet
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg not downloaded yet
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_42c0f5f8e951d5099aea05526833105c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_42c0f5f8e951d5099aea05526833105c.jpg not downloaded yet
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: CG62128
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CG62128%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for CG62128: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: ZB71689
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZB71689%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for ZB71689: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: EE02681
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EE02681%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for EE02681: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: PY48154
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PY48154%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for PY48154: 0
2026-01-28 17:08:33 [auto1.es] INFO: Found listing with ID: AL99452
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL99452%27 HTTP/1.1" 200 None
2026-01-28 17:08:33 [auto1.es] INFO: Scrape type for AL99452: 2
2026-01-28 17:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE48762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with identifier: EY58964
2026-01-28 17:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with scrape type 2
2026-01-28 17:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with scrape type 2
2026-01-28 17:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1dec52ef-ffd9-5c9f-9226-956ab3de4d88, identifier: EY58964
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625f1750>
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg saved to cache
2026-01-28 17:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e6e50>
2026-01-28 17:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_4282721c5a2904058351f59b26d19662.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_4282721c5a2904058351f59b26d19662.jpg saved to cache
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62813d10>
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_17cff129a4f44e65389a9374195b3771.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_17cff129a4f44e65389a9374195b3771.jpg saved to cache
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63362610>
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_3c9432a65d9a2ab43206debb6b339958.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_3c9432a65d9a2ab43206debb6b339958.jpg saved to cache
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626219d0>
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_1a4138beaf154d4075fabf060673578a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_1a4138beaf154d4075fabf060673578a.jpg saved to cache
2026-01-28 17:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627dc790>
2026-01-28 17:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_f43f67e586d6261f677ed9917946532f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_f43f67e586d6261f677ed9917946532f.jpg saved to cache
2026-01-28 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_a49020d8affae06833232950d2ea90ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_a49020d8affae06833232950d2ea90ed.jpg not downloaded yet
2026-01-28 17:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with identifier: EY58964
2026-01-28 17:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with identifier: EY58964
2026-01-28 17:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 1dec52ef-ffd9-5c9f-9226-956ab3de4d88 with identifier: EY58964 to the API
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EY58964>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-01-29T16:45:35Z',
 'fuel_type': 'petrol',
 'id': '1dec52ef-ffd9-5c9f-9226-956ab3de4d88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY58964',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 100083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2021}
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY58964%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Saving data for EY58964: {'auction_closing_time': 1769705135.0, 'created_time': 1766063522.222462, 'last_price_update_time': 1769620116.570197}
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY58964') HTTP/1.1" 204 0
2026-01-28 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2898f89cb2ee2bfc73e33436a220555a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_eb1fec7577095a1627339789c3a3128b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_c789416fc0db8bf802764fc635ed5507.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_d6378d24dd10490b39bad84c86fd10ed.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg not downloaded yet
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_6b78da03662852cc35b61e6c97cca343.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_6b78da03662852cc35b61e6c97cca343.jpg not downloaded yet
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: VD07313
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VD07313%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for VD07313: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: RJ21512
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ21512%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for RJ21512: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: FU04636
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU04636%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for FU04636: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: RZ61844
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ61844%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for RZ61844: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: AJ41556
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AJ41556%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for AJ41556: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: DX90294
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DX90294%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for DX90294: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: ZF58573
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZF58573%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for ZF58573: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: TD74745
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TD74745%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for TD74745: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: WY87549
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WY87549%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for WY87549: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: HD00018
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HD00018%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for HD00018: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: NC81408
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NC81408%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for NC81408: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: LX25813
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LX25813%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for LX25813: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: GC80104
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GC80104%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for GC80104: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: NM49445
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NM49445%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for NM49445: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: FH33557
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FH33557%27 HTTP/1.1" 200 None
2026-01-28 17:08:36 [auto1.es] INFO: Scrape type for FH33557: 0
2026-01-28 17:08:36 [auto1.es] INFO: Found listing with ID: GJ14568
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GJ14568%27 HTTP/1.1" 200 None
2026-01-28 17:08:37 [auto1.es] INFO: Scrape type for GJ14568: 0
2026-01-28 17:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62755390>
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_031be2fa6eb1866e65f3caff20539a75.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_031be2fa6eb1866e65f3caff20539a75.jpg saved to cache
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_20158f112ada6a15f72fabebc19a5fcd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_20158f112ada6a15f72fabebc19a5fcd.jpg not downloaded yet
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW51113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME67381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV12563/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_815afa764ffc8d0e006dd618226fb16f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_815afa764ffc8d0e006dd618226fb16f.jpg not downloaded yet
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_135b86bfd0e49865914d03d82f80540d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_135b86bfd0e49865914d03d82f80540d.jpg not downloaded yet
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg not downloaded yet
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625eb210>
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg saved to cache
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f9550>
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_2898f89cb2ee2bfc73e33436a220555a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2898f89cb2ee2bfc73e33436a220555a.jpg saved to cache
2026-01-28 17:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6334d5d0>
2026-01-28 17:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_eb1fec7577095a1627339789c3a3128b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_eb1fec7577095a1627339789c3a3128b.jpg saved to cache
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624f6150>
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_c789416fc0db8bf802764fc635ed5507.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_c789416fc0db8bf802764fc635ed5507.jpg saved to cache
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63543a50>
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_d6378d24dd10490b39bad84c86fd10ed.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_d6378d24dd10490b39bad84c86fd10ed.jpg saved to cache
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_e0afa27fb438c8b182583b536c505344.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e0afa27fb438c8b182583b536c505344.jpg not downloaded yet
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_743534faf94b56e4a9fc454c4495f0e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_743534faf94b56e4a9fc454c4495f0e1.jpg not downloaded yet
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_a49020d8affae06833232950d2ea90ed.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_42c0f5f8e951d5099aea05526833105c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg not downloaded yet
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_cad7606c0f3a4f73ead3d1f156512397.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ece5016171cf561885094ab5b2916aef.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_9d524479fb8d8372e394618e1d22c050.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2ef93480324e5f61730b07c27191739d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_93197c02f72e8d4333cac17f71045f1d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_93197c02f72e8d4333cac17f71045f1d.jpg not downloaded yet
2026-01-28 17:08:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c043483b741c3d5fea44fe585125f334.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_9a20db9563931b499e9f7a0fe46148c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9a20db9563931b499e9f7a0fe46148c0.jpg not downloaded yet
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_34550a8373c19010e44034a02f18104e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_34550a8373c19010e44034a02f18104e.jpg not downloaded yet
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63424990>
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg saved to cache
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6278e2d0>
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg saved to cache
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:39 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_591c9b798d59ba136f030dbf1f0123ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_591c9b798d59ba136f030dbf1f0123ec.jpg not downloaded yet
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_815afa764ffc8d0e006dd618226fb16f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_6b78da03662852cc35b61e6c97cca343.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_afee416e192b451f9518e0d3c2220b9a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_afee416e192b451f9518e0d3c2220b9a.jpg not downloaded yet
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: MH96539
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH96539%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for MH96539: 0
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: XL99979
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL99979%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for XL99979: 0
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: YB95625
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YB95625%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for YB95625: 0
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: FX90813
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX90813%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for FX90813: 0
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: BV37425
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BV37425%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for BV37425: 0
2026-01-28 17:08:39 [auto1.es] INFO: Found listing with ID: JC57024
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [auto1.es] INFO: Scrape type for JC57024: 2
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_135b86bfd0e49865914d03d82f80540d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_14048e20cd7c2b347283d7bbf222786f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_91f9ab25d3587f752f8b84149970c431.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_91f9ab25d3587f752f8b84149970c431.jpg not downloaded yet
2026-01-28 17:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH63852/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62506410>
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg saved to cache
2026-01-28 17:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6275d890>
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_a49020d8affae06833232950d2ea90ed.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_a49020d8affae06833232950d2ea90ed.jpg saved to cache
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62785c90>
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_42c0f5f8e951d5099aea05526833105c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_42c0f5f8e951d5099aea05526833105c.jpg saved to cache
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63334090>
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_cad7606c0f3a4f73ead3d1f156512397.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_cad7606c0f3a4f73ead3d1f156512397.jpg saved to cache
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6255e8d0>
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_ece5016171cf561885094ab5b2916aef.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ece5016171cf561885094ab5b2916aef.jpg saved to cache
2026-01-28 17:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62808e10>
2026-01-28 17:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_9d524479fb8d8372e394618e1d22c050.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_9d524479fb8d8372e394618e1d22c050.jpg saved to cache
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63489f10>
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_2ef93480324e5f61730b07c27191739d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2ef93480324e5f61730b07c27191739d.jpg saved to cache
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633361d0>
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_c043483b741c3d5fea44fe585125f334.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c043483b741c3d5fea44fe585125f334.jpg saved to cache
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg not downloaded yet
2026-01-28 17:08:41 [auto1.es] INFO: Found listing with ID: KP50640
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KP50640%27 HTTP/1.1" 200 None
2026-01-28 17:08:41 [auto1.es] INFO: Scrape type for KP50640: 0
2026-01-28 17:08:41 [auto1.es] INFO: Found listing with ID: EC42327
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC42327%27 HTTP/1.1" 200 None
2026-01-28 17:08:41 [auto1.es] INFO: Scrape type for EC42327: 2
2026-01-28 17:08:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_743534faf94b56e4a9fc454c4495f0e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_1c0efdf14d407995488519fe86588f0e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_1c0efdf14d407995488519fe86588f0e.jpg not downloaded yet
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aaf7d0>
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg saved to cache
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627da5d0>
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_815afa764ffc8d0e006dd618226fb16f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_815afa764ffc8d0e006dd618226fb16f.jpg saved to cache
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624ac410>
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_6b78da03662852cc35b61e6c97cca343.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_6b78da03662852cc35b61e6c97cca343.jpg saved to cache
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_93197c02f72e8d4333cac17f71045f1d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:42 [auto1.es] INFO: Found listing with ID: LY61311
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LY61311%27 HTTP/1.1" 200 None
2026-01-28 17:08:42 [auto1.es] INFO: Scrape type for LY61311: 0
2026-01-28 17:08:42 [auto1.es] INFO: Found listing with ID: JB20190
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JB20190%27 HTTP/1.1" 200 None
2026-01-28 17:08:42 [auto1.es] INFO: Scrape type for JB20190: 0
2026-01-28 17:08:42 [auto1.es] INFO: Found listing with ID: RZ88845
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ88845%27 HTTP/1.1" 200 None
2026-01-28 17:08:42 [auto1.es] INFO: Scrape type for RZ88845: 2
2026-01-28 17:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XD38373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626bd0d0>
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg saved to cache
2026-01-28 17:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63501190>
2026-01-28 17:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg saved to cache
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635001d0>
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_135b86bfd0e49865914d03d82f80540d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_135b86bfd0e49865914d03d82f80540d.jpg saved to cache
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626745d0>
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_14048e20cd7c2b347283d7bbf222786f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_14048e20cd7c2b347283d7bbf222786f.jpg saved to cache
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e0afa27fb438c8b182583b536c505344.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_20158f112ada6a15f72fabebc19a5fcd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_591c9b798d59ba136f030dbf1f0123ec.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg not downloaded yet
2026-01-28 17:08:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9a20db9563931b499e9f7a0fe46148c0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_34550a8373c19010e44034a02f18104e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: DL86494
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DL86494%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for DL86494: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: PA82010
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA82010%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for PA82010: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: EM14383
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM14383%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for EM14383: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: CZ86018
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CZ86018%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for CZ86018: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: UL25589
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UL25589%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for UL25589: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: PS03638
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PS03638%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for PS03638: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: LR65108
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LR65108%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for LR65108: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: GX15392
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GX15392%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for GX15392: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: XU50819
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XU50819%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for XU50819: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: FU94451
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FU94451%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for FU94451: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: JW99800
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JW99800%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for JW99800: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: NR44611
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NR44611%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for NR44611: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: ZD97548
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD97548%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for ZD97548: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: GT01494
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GT01494%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for GT01494: 0
2026-01-28 17:08:43 [auto1.es] INFO: Found listing with ID: EN57329
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN57329%27 HTTP/1.1" 200 None
2026-01-28 17:08:43 [auto1.es] INFO: Scrape type for EN57329: 2
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN19670/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE48762> (referer: https://www.auto1.com/v1/car-details-view/BE48762/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL99452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635da210>
2026-01-28 17:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_743534faf94b56e4a9fc454c4495f0e1.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_743534faf94b56e4a9fc454c4495f0e1.jpg saved to cache
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_09e722f4ceda5794c337daf9374ca059.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_09e722f4ceda5794c337daf9374ca059.jpg not downloaded yet
2026-01-28 17:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_91f9ab25d3587f752f8b84149970c431.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:44 [auto1.es] INFO: Found listing with ID: UT91122
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT91122%27 HTTP/1.1" 200 None
2026-01-28 17:08:44 [auto1.es] INFO: Scrape type for UT91122: 2
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63403650>
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_93197c02f72e8d4333cac17f71045f1d.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_93197c02f72e8d4333cac17f71045f1d.jpg saved to cache
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg not downloaded yet
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272a950>
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_e0afa27fb438c8b182583b536c505344.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e0afa27fb438c8b182583b536c505344.jpg saved to cache
2026-01-28 17:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a2f190>
2026-01-28 17:08:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_20158f112ada6a15f72fabebc19a5fcd.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_20158f112ada6a15f72fabebc19a5fcd.jpg saved to cache
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62719d50>
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_591c9b798d59ba136f030dbf1f0123ec.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_591c9b798d59ba136f030dbf1f0123ec.jpg saved to cache
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62571f50>
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_9a20db9563931b499e9f7a0fe46148c0.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9a20db9563931b499e9f7a0fe46148c0.jpg saved to cache
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6343ac90>
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_34550a8373c19010e44034a02f18104e.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_34550a8373c19010e44034a02f18104e.jpg saved to cache
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b28e6a2e-e455-50e5-874b-ca89544c33ab with identifier: BE48762
2026-01-28 17:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b28e6a2e-e455-50e5-874b-ca89544c33ab with scrape type 2
2026-01-28 17:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b28e6a2e-e455-50e5-874b-ca89544c33ab with scrape type 2
2026-01-28 17:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b28e6a2e-e455-50e5-874b-ca89544c33ab, identifier: BE48762
2026-01-28 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_1c0efdf14d407995488519fe86588f0e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: CM10234
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CM10234%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for CM10234: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: KH31340
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KH31340%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for KH31340: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: ML88994
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML88994%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for ML88994: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: FN07942
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN07942%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for FN07942: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: YA52263
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YA52263%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for YA52263: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: UT31278
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT31278%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for UT31278: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: WW85834
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WW85834%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for WW85834: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: SG12491
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SG12491%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for SG12491: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: PA61083
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PA61083%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for PA61083: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: TC12412
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TC12412%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for TC12412: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: ZM36489
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZM36489%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for ZM36489: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: XW32835
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XW32835%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for XW32835: 0
2026-01-28 17:08:46 [auto1.es] INFO: Found listing with ID: DB35295
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DB35295%27 HTTP/1.1" 200 None
2026-01-28 17:08:46 [auto1.es] INFO: Scrape type for DB35295: 0
2026-01-28 17:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b28e6a2e-e455-50e5-874b-ca89544c33ab with identifier: BE48762
2026-01-28 17:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b28e6a2e-e455-50e5-874b-ca89544c33ab with identifier: BE48762
2026-01-28 17:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b28e6a2e-e455-50e5-874b-ca89544c33ab with identifier: BE48762 to the API
2026-01-28 17:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BE48762>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 265,
 'expiration_date': '2026-01-29T16:19:07Z',
 'fuel_type': 'hybrid',
 'id': 'b28e6a2e-e455-50e5-874b-ca89544c33ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE48762',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 85524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-26',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Kia Sorento 1.6 TGDI Plug-in Hybrid Emotion 4WD',
 'transmission': 'automatic',
 'trim': 'Emotion 4WD',
 'year': 2021}
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BE48762%27 HTTP/1.1" 200 None
2026-01-28 17:08:47 [auto1.es] INFO: Saving data for BE48762: {'auction_closing_time': 1769703547.0, 'created_time': 1769187974.849108, 'last_price_update_time': 1769620127.202207}
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BE48762') HTTP/1.1" 204 0
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_98611a3b59206850d3bdbcebfefd84a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_d1be7f7a4b43d5046571401d2b726a75.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_afee416e192b451f9518e0d3c2220b9a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_34c853dce9ba76d885bb303a87dcced0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_34c853dce9ba76d885bb303a87dcced0.jpg not downloaded yet
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW51113> (referer: https://www.auto1.com/v1/car-details-view/ZW51113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62610610>
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_91f9ab25d3587f752f8b84149970c431.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_91f9ab25d3587f752f8b84149970c431.jpg saved to cache
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV12563> (referer: https://www.auto1.com/v1/car-details-view/GV12563/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME67381> (referer: https://www.auto1.com/v1/car-details-view/ME67381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg not downloaded yet
2026-01-28 17:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62692810>
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_1c0efdf14d407995488519fe86588f0e.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_1c0efdf14d407995488519fe86588f0e.jpg saved to cache
2026-01-28 17:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ecad0>
2026-01-28 17:08:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg saved to cache
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e4810>
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_98611a3b59206850d3bdbcebfefd84a5.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_98611a3b59206850d3bdbcebfefd84a5.jpg saved to cache
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6262de50>
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_d1be7f7a4b43d5046571401d2b726a75.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_d1be7f7a4b43d5046571401d2b726a75.jpg saved to cache
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62955790>
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_afee416e192b451f9518e0d3c2220b9a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_afee416e192b451f9518e0d3c2220b9a.jpg saved to cache
2026-01-28 17:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633755d0>
2026-01-28 17:08:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg saved to cache
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with identifier: ZW51113
2026-01-28 17:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with scrape type 2
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with scrape type 2
2026-01-28 17:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8ee3dcc8-b47e-5621-bf0c-2e51f6731803, identifier: ZW51113
2026-01-28 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_09e722f4ceda5794c337daf9374ca059.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with identifier: ZW51113
2026-01-28 17:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with identifier: ZW51113
2026-01-28 17:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8ee3dcc8-b47e-5621-bf0c-2e51f6731803 with identifier: ZW51113 to the API
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW51113>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 195,
 'expiration_date': '2026-01-29T16:26:19Z',
 'fuel_type': 'petrol',
 'id': '8ee3dcc8-b47e-5621-bf0c-2e51f6731803',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW51113',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 120572,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 Zenith 2WD',
 'transmission': 'automatic',
 'trim': 'Zenith 2WD',
 'year': 2019}
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZW51113%27 HTTP/1.1" 200 None
2026-01-28 17:08:49 [auto1.es] INFO: Saving data for ZW51113: {'auction_closing_time': 1769703979.0, 'created_time': 1769189078.568024, 'last_price_update_time': 1769620129.59932}
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZW51113') HTTP/1.1" 204 0
2026-01-28 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ88845/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC42327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH63852> (referer: https://www.auto1.com/v1/car-details-view/HH63852/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635271d0>
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg saved to cache
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:49 [auto1.es] INFO: Parsing search results for channel: 24h
2026-01-28 17:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d86a2b75-9070-5672-8f18-d4b126eb9428 with identifier: GV12563
2026-01-28 17:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d86a2b75-9070-5672-8f18-d4b126eb9428 with scrape type 2
2026-01-28 17:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d86a2b75-9070-5672-8f18-d4b126eb9428 with scrape type 2
2026-01-28 17:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d86a2b75-9070-5672-8f18-d4b126eb9428, identifier: GV12563
2026-01-28 17:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d9b70cf-36af-5181-b612-c66f941b67de with identifier: ME67381
2026-01-28 17:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d9b70cf-36af-5181-b612-c66f941b67de with scrape type 2
2026-01-28 17:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d9b70cf-36af-5181-b612-c66f941b67de with scrape type 2
2026-01-28 17:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5d9b70cf-36af-5181-b612-c66f941b67de, identifier: ME67381
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_aefc54a5828e35885bf5b73a7196fe29.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_34c853dce9ba76d885bb303a87dcced0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC57024/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d86a2b75-9070-5672-8f18-d4b126eb9428 with identifier: GV12563
2026-01-28 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d86a2b75-9070-5672-8f18-d4b126eb9428 with identifier: GV12563
2026-01-28 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 36638, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gv12563', 'expiration_date': '2026-01-29t16:29:53z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, aldaya', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'd86a2b75-9070-5672-8f18-d4b126eb9428', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 36638}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:29:53z',
     'fuel_type': 'petrol',
     'id': 'd86a2b75-9070-5672-8f18-d4b126eb9428',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gv12563',
     'listing': 'auction',
     'location': 'es, aldaya',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 36638,
     'odometer_in_km': 36638,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-26',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-28 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: d86a2b75-9070-5672-8f18-d4b126eb9428 spider: auto1.es
2026-01-28 17:08:50 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d86a2b75-9070-5672-8f18-d4b126eb9428 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 36638, 'odometer_reading_unit': 'km', 'registration_date': '2017-02-26', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gv12563', 'expiration_date': '2026-01-29t16:29:53z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, aldaya', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': 'd86a2b75-9070-5672-8f18-d4b126eb9428', 'current_year_diff': 9, 'age_in_months': 107, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 36638}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 107,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:29:53z',
     'fuel_type': 'petrol',
     'id': 'd86a2b75-9070-5672-8f18-d4b126eb9428',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/gv12563',
     'listing': 'auction',
     'location': 'es, aldaya',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 36638,
     'odometer_in_km': 36638,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-02-26',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:29:53Z',
 'fuel_type': 'petrol',
 'id': 'd86a2b75-9070-5672-8f18-d4b126eb9428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV12563',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 36638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GV12563%27 HTTP/1.1" 200 None
2026-01-28 17:08:50 [auto1.es] INFO: Saving data for GV12563: {'auction_closing_time': 1769704193.0, 'created_time': 1769187727.209255, 'last_price_update_time': 1769620130.359842}
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GV12563') HTTP/1.1" 204 0
2026-01-28 17:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5d9b70cf-36af-5181-b612-c66f941b67de with identifier: ME67381
2026-01-28 17:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5d9b70cf-36af-5181-b612-c66f941b67de with identifier: ME67381
2026-01-28 17:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 5d9b70cf-36af-5181-b612-c66f941b67de with identifier: ME67381 to the API
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ME67381>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:22:17Z',
 'fuel_type': 'petrol',
 'id': '5d9b70cf-36af-5181-b612-c66f941b67de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME67381',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 108619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR Edition',
 'transmission': 'manual',
 'trim': 'FR Edition',
 'year': 2019}
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ME67381%27 HTTP/1.1" 200 None
2026-01-28 17:08:50 [auto1.es] INFO: Saving data for ME67381: {'auction_closing_time': 1769703737.0, 'created_time': 1769187845.082164, 'last_price_update_time': 1769620130.68609}
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ME67381') HTTP/1.1" 204 0
2026-01-28 17:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62582e10>
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_09e722f4ceda5794c337daf9374ca059.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_09e722f4ceda5794c337daf9374ca059.jpg saved to cache
2026-01-28 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62937c50>
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg saved to cache
2026-01-28 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with identifier: HH63852
2026-01-28 17:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with scrape type 2
2026-01-28 17:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with scrape type 2
2026-01-28 17:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dfc58e6e-9f33-5c2e-8f9e-56101d9f3690, identifier: HH63852
2026-01-28 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_721dc791957a3655b69773b02823822c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with identifier: HH63852
2026-01-28 17:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with identifier: HH63852
2026-01-28 17:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dfc58e6e-9f33-5c2e-8f9e-56101d9f3690 with identifier: HH63852 to the API
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH63852>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:07:20Z',
 'fuel_type': 'diesel',
 'id': 'dfc58e6e-9f33-5c2e-8f9e-56101d9f3690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH63852',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 122148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2017}
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HH63852%27 HTTP/1.1" 200 None
2026-01-28 17:08:51 [auto1.es] INFO: Saving data for HH63852: {'auction_closing_time': 1769702840.0, 'created_time': 1769187660.259637, 'last_price_update_time': 1769620131.748289}
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HH63852') HTTP/1.1" 204 0
2026-01-28 17:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_aa286105cbba46a72a632246fcbcba45.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a32a50>
2026-01-28 17:08:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg saved to cache
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f73d0>
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc2%252Fe5%252Fc2e557e5be499ec9d105b5fec3ed7dbb%252Fpa%252FCH74884_aefc54a5828e35885bf5b73a7196fe29.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_aefc54a5828e35885bf5b73a7196fe29.jpg saved to cache
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b
2026-01-28 17:08:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b, skipping ID generation
2026-01-28 17:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b with scrape type 1
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b from tracking dictionaries
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ea0d590-450a-5b19-9190-ca89e5fd2e9b sending to next pipeline
2026-01-28 17:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b, identifier: CH74884
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6298c990>
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_34c853dce9ba76d885bb303a87dcced0.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_34c853dce9ba76d885bb303a87dcced0.jpg saved to cache
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6271b550>
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg saved to cache
2026-01-28 17:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62318110>
2026-01-28 17:08:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg saved to cache
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_38f9c802501512ef682d178faa957471.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b with identifier: CH74884
2026-01-28 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b with identifier: CH74884
2026-01-28 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-28 17:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b spider: auto1.es
2026-01-28 17:08:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7ea0d590-450a-5b19-9190-ca89e5fd2e9b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:55:45Z',
 'fuel_type': 'diesel',
 'id': '7ea0d590-450a-5b19-9190-ca89e5fd2e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH74884',
 'listing': 'auction',
 'location': 'ES, Tudela',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 24903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2468ed476a36fade67cb8fedf4829dab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78754,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_288d8fe8d98e9a7a638c48ac60d4d646.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_1a4138beaf154d4075fabf060673578a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_3c9432a65d9a2ab43206debb6b339958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87965,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_d6378d24dd10490b39bad84c86fd10ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_39861a78c5254b2ecf7936c2b1f0e731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_aefc54a5828e35885bf5b73a7196fe29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_2ef93480324e5f61730b07c27191739d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_42c0f5f8e951d5099aea05526833105c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_6b78da03662852cc35b61e6c97cca343.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_135b86bfd0e49865914d03d82f80540d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_743534faf94b56e4a9fc454c4495f0e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_93197c02f72e8d4333cac17f71045f1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_34550a8373c19010e44034a02f18104e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_afee416e192b451f9518e0d3c2220b9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ea0d590-450a-5b19-9190-ca89e5fd2e9b/7ea0d590-450a-5b19-9190-ca89e5fd2e9b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc2/e5/c2e557e5be499ec9d105b5fec3ed7dbb/pa/CH74884_89e3fe9ae3dcfa988d825d532abd1f1e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-25',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi',
 'transmission': 'manual',
 'trim': 'Maxi',
 'year': 2023}
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CH74884%27 HTTP/1.1" 200 None
2026-01-28 17:08:53 [auto1.es] INFO: Saving data for CH74884: {'created_time': 1769620133.466511, 'last_price_update_time': 1769620133.466523, 'auction_closing_time': 1769705745.0}
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CH74884') HTTP/1.1" 204 0
2026-01-28 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_803e3a17746357ecd8f1dc488208a9a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_b1793441685c1fd27d3965efecdc4f71.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f72812b8d5a03d856fd66e3384e04133.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293d4d0>
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_721dc791957a3655b69773b02823822c.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_721dc791957a3655b69773b02823822c.jpg saved to cache
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634d1390>
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb90e155eb3b472dac68cdc4ed445a7%252Fpa%252FAL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg saved to cache
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5
2026-01-28 17:08:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5, skipping ID generation
2026-01-28 17:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with scrape type 1
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 from tracking dictionaries
2026-01-28 17:08:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 sending to next pipeline
2026-01-28 17:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5, identifier: AL50426
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN57329/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN19670> (referer: https://www.auto1.com/v1/car-details-view/GN19670/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL99452> (referer: https://www.auto1.com/v1/car-details-view/AL99452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XD38373> (referer: https://www.auto1.com/v1/car-details-view/XD38373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with identifier: AL50426
2026-01-28 17:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with identifier: AL50426
2026-01-28 17:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6d6c748b-0a9e-5ee5-8711-1d3a768553a5 with identifier: AL50426 to the API
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 106,
 'expiration_date': '2026-01-29T16:25:33Z',
 'fuel_type': 'petrol',
 'id': '6d6c748b-0a9e-5ee5-8711-1d3a768553a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL50426',
 'listing': 'auction',
 'location': 'ES, Massalfassar',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 21590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_eb1fec7577095a1627339789c3a3128b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_98611a3b59206850d3bdbcebfefd84a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_cad7606c0f3a4f73ead3d1f156512397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_a49020d8affae06833232950d2ea90ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_20158f112ada6a15f72fabebc19a5fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_905e3330ceec8ebf3d4fa9b88ff73e85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_08c2c1323a06eaca42b2eb70f247b06b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9a20db9563931b499e9f7a0fe46148c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_591c9b798d59ba136f030dbf1f0123ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_91f9ab25d3587f752f8b84149970c431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_1c0efdf14d407995488519fe86588f0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_36421ebd240c3cfdf3ebcc827fdd154b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_09e722f4ceda5794c337daf9374ca059.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_182afb5f6d922d939a2ca0b2e3cf391e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_34c853dce9ba76d885bb303a87dcced0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d6c748b-0a9e-5ee5-8711-1d3a768553a5/6d6c748b-0a9e-5ee5-8711-1d3a768553a5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb90e155eb3b472dac68cdc4ed445a7/pa/AL50426_9fd83b0c56298fbefdb9afb3a720c15f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2024}
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL50426%27 HTTP/1.1" 200 None
2026-01-28 17:08:54 [auto1.es] INFO: Saving data for AL50426: {'created_time': 1769620134.448089, 'last_price_update_time': 1769620134.4481, 'auction_closing_time': 1769703933.0}
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL50426') HTTP/1.1" 204 0
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d52d0>
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_aa286105cbba46a72a632246fcbcba45.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_aa286105cbba46a72a632246fcbcba45.jpg saved to cache
2026-01-28 17:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_3f862a41674ca425b4b12a0171f137b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_72fc86e113bc6ead350be8dc8086aa23.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269b390>
2026-01-28 17:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg saved to cache
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62acc6d0>
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_38f9c802501512ef682d178faa957471.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_38f9c802501512ef682d178faa957471.jpg saved to cache
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62935090>
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_803e3a17746357ecd8f1dc488208a9a2.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_803e3a17746357ecd8f1dc488208a9a2.jpg saved to cache
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bee50>
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_b1793441685c1fd27d3965efecdc4f71.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_b1793441685c1fd27d3965efecdc4f71.jpg saved to cache
2026-01-28 17:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62934350>
2026-01-28 17:08:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_f72812b8d5a03d856fd66e3384e04133.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f72812b8d5a03d856fd66e3384e04133.jpg saved to cache
2026-01-28 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bce9455-253a-5974-be42-aec0d9ede26e with identifier: GN19670
2026-01-28 17:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bce9455-253a-5974-be42-aec0d9ede26e with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bce9455-253a-5974-be42-aec0d9ede26e with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8bce9455-253a-5974-be42-aec0d9ede26e, identifier: GN19670
2026-01-28 17:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775f3ba1-8f10-569f-8d8f-24ab581b2934 with identifier: AL99452
2026-01-28 17:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775f3ba1-8f10-569f-8d8f-24ab581b2934 with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 775f3ba1-8f10-569f-8d8f-24ab581b2934 with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 775f3ba1-8f10-569f-8d8f-24ab581b2934, identifier: AL99452
2026-01-28 17:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49057e33-3fe7-59e3-b219-6d38c3a55e4b with identifier: XD38373
2026-01-28 17:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49057e33-3fe7-59e3-b219-6d38c3a55e4b with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49057e33-3fe7-59e3-b219-6d38c3a55e4b with scrape type 2
2026-01-28 17:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 49057e33-3fe7-59e3-b219-6d38c3a55e4b, identifier: XD38373
2026-01-28 17:08:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8bce9455-253a-5974-be42-aec0d9ede26e with identifier: GN19670
2026-01-28 17:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8bce9455-253a-5974-be42-aec0d9ede26e with identifier: GN19670
2026-01-28 17:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8bce9455-253a-5974-be42-aec0d9ede26e with identifier: GN19670 to the API
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN19670>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:07:48Z',
 'fuel_type': 'diesel',
 'id': '8bce9455-253a-5974-be42-aec0d9ede26e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN19670',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 46809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style Visio Edition',
 'transmission': 'manual',
 'trim': 'Style Visio Edition',
 'year': 2019}
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GN19670%27 HTTP/1.1" 200 None
2026-01-28 17:08:56 [auto1.es] INFO: Saving data for GN19670: {'auction_closing_time': 1769702868.0, 'created_time': 1769187721.969924, 'last_price_update_time': 1769620136.901735}
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GN19670') HTTP/1.1" 204 0
2026-01-28 17:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 775f3ba1-8f10-569f-8d8f-24ab581b2934 with identifier: AL99452
2026-01-28 17:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 775f3ba1-8f10-569f-8d8f-24ab581b2934 with identifier: AL99452
2026-01-28 17:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 775f3ba1-8f10-569f-8d8f-24ab581b2934 with identifier: AL99452 to the API
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AL99452>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:07Z',
 'fuel_type': 'petrol',
 'id': '775f3ba1-8f10-569f-8d8f-24ab581b2934',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL99452',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 21481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Style Go',
 'transmission': 'automatic',
 'trim': 'Style Go',
 'year': 2024}
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AL99452%27 HTTP/1.1" 200 None
2026-01-28 17:08:57 [auto1.es] INFO: Saving data for AL99452: {'auction_closing_time': 1769703367.0, 'created_time': 1768912869.38445, 'last_price_update_time': 1769620137.215857}
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AL99452') HTTP/1.1" 204 0
2026-01-28 17:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 49057e33-3fe7-59e3-b219-6d38c3a55e4b with identifier: XD38373
2026-01-28 17:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 49057e33-3fe7-59e3-b219-6d38c3a55e4b with identifier: XD38373
2026-01-28 17:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 49057e33-3fe7-59e3-b219-6d38c3a55e4b with identifier: XD38373 to the API
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XD38373>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:22:27Z',
 'fuel_type': 'gas',
 'id': '49057e33-3fe7-59e3-b219-6d38c3a55e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD38373',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 103464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 TCe Energy Benzin / LPG Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XD38373%27 HTTP/1.1" 200 None
2026-01-28 17:08:57 [auto1.es] INFO: Saving data for XD38373: {'auction_closing_time': 1769703747.0, 'created_time': 1769187816.687711, 'last_price_update_time': 1769620137.525296}
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XD38373') HTTP/1.1" 204 0
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625300d0>
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg saved to cache
2026-01-28 17:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627deb50>
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_3f862a41674ca425b4b12a0171f137b0.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_3f862a41674ca425b4b12a0171f137b0.jpg saved to cache
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6231a050>
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_72fc86e113bc6ead350be8dc8086aa23.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_72fc86e113bc6ead350be8dc8086aa23.jpg saved to cache
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628f4d10>
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg saved to cache
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_e154b6512201b5145a9432e1e087e5f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_4018187b50ee0106e3932ebbf488efa0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca6ae4ac56167c16425f2284521fb31a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c7c02121dce294cff1ec614d955ee45e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT91122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ88845> (referer: https://www.auto1.com/v1/car-details-view/RZ88845/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC42327> (referer: https://www.auto1.com/v1/car-details-view/EC42327/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63479210>
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg saved to cache
2026-01-28 17:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6271ab50>
2026-01-28 17:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg saved to cache
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:08:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_2064d85f466cbc0785f27d884b308887.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63471f10>
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg saved to cache
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633632d0>
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg saved to cache
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635cdd50>
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg') HTTP/1.1" 204 0
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg saved to cache
2026-01-28 17:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63361550>
2026-01-28 17:08:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_e154b6512201b5145a9432e1e087e5f2.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_e154b6512201b5145a9432e1e087e5f2.jpg saved to cache
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635fba10>
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fbb%252Fa2bb956853b32a8fe6c73dab5bca9058%252Fpa%252FHV22353_4018187b50ee0106e3932ebbf488efa0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_4018187b50ee0106e3932ebbf488efa0.jpg saved to cache
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d23f277-1273-5d07-a9dd-b2a8364e977d
2026-01-28 17:09:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d23f277-1273-5d07-a9dd-b2a8364e977d, skipping ID generation
2026-01-28 17:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d23f277-1273-5d07-a9dd-b2a8364e977d with scrape type 1
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9d23f277-1273-5d07-a9dd-b2a8364e977d from tracking dictionaries
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d23f277-1273-5d07-a9dd-b2a8364e977d sending to next pipeline
2026-01-28 17:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9d23f277-1273-5d07-a9dd-b2a8364e977d, identifier: HV22353
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a50d10>
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_ca6ae4ac56167c16425f2284521fb31a.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca6ae4ac56167c16425f2284521fb31a.jpg saved to cache
2026-01-28 17:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272b350>
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_c7c02121dce294cff1ec614d955ee45e.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c7c02121dce294cff1ec614d955ee45e.jpg saved to cache
2026-01-28 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb7c6451-17ca-565d-9be5-e2d2f0800f38 with identifier: RZ88845
2026-01-28 17:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb7c6451-17ca-565d-9be5-e2d2f0800f38 with scrape type 2
2026-01-28 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb7c6451-17ca-565d-9be5-e2d2f0800f38 with scrape type 2
2026-01-28 17:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eb7c6451-17ca-565d-9be5-e2d2f0800f38, identifier: RZ88845
2026-01-28 17:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29f72eec-9aa6-59d7-996b-b2fc781708fa with identifier: EC42327
2026-01-28 17:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29f72eec-9aa6-59d7-996b-b2fc781708fa with scrape type 2
2026-01-28 17:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29f72eec-9aa6-59d7-996b-b2fc781708fa with scrape type 2
2026-01-28 17:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 29f72eec-9aa6-59d7-996b-b2fc781708fa, identifier: EC42327
2026-01-28 17:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9d23f277-1273-5d07-a9dd-b2a8364e977d with identifier: HV22353
2026-01-28 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9d23f277-1273-5d07-a9dd-b2a8364e977d with identifier: HV22353
2026-01-28 17:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9d23f277-1273-5d07-a9dd-b2a8364e977d with identifier: HV22353 to the API
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_4018187b50ee0106e3932ebbf488efa0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:19:30Z',
 'fuel_type': 'diesel',
 'id': '9d23f277-1273-5d07-a9dd-b2a8364e977d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV22353',
 'listing': 'auction',
 'location': 'Lugones',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 68098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_37f8e36a1e1e69234549e21106c66d3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_83f0629f88120d2a1a9e5b19e90c5b0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_a5e5b5e885b221991d0625d395591910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_8843236c2eb7501c5629d2e2504a4ebc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_4018187b50ee0106e3932ebbf488efa0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_f43f67e586d6261f677ed9917946532f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ec91b78f7eb454c4540a290b1c79eb3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_031be2fa6eb1866e65f3caff20539a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_c789416fc0db8bf802764fc635ed5507.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_ece5016171cf561885094ab5b2916aef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_6e3b511aabedc4c631b99afd0d3c3654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_3a85dd93fc1ba349c79070de7a1a19a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_352d1bdfbe87e2c9374cf7ef405a4bd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e07d99c6c90e9e4b191616a5fc7bd395.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55093,
             'Height': 597,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_815afa764ffc8d0e006dd618226fb16f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d23f277-1273-5d07-a9dd-b2a8364e977d/9d23f277-1273-5d07-a9dd-b2a8364e977d_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/bb/a2bb956853b32a8fe6c73dab5bca9058/pa/HV22353_e0afa27fb438c8b182583b536c505344.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HV22353%27 HTTP/1.1" 200 None
2026-01-28 17:09:01 [auto1.es] INFO: Saving data for HV22353: {'created_time': 1769620141.595444, 'last_price_update_time': 1769620141.595456, 'auction_closing_time': 1769703570.0}
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HV22353') HTTP/1.1" 204 0
2026-01-28 17:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eb7c6451-17ca-565d-9be5-e2d2f0800f38 with identifier: RZ88845
2026-01-28 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eb7c6451-17ca-565d-9be5-e2d2f0800f38 with identifier: RZ88845
2026-01-28 17:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eb7c6451-17ca-565d-9be5-e2d2f0800f38 with identifier: RZ88845 to the API
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RZ88845>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:12:07Z',
 'fuel_type': 'petrol',
 'id': 'eb7c6451-17ca-565d-9be5-e2d2f0800f38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ88845',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 122178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT e-TEC Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RZ88845%27 HTTP/1.1" 200 None
2026-01-28 17:09:01 [auto1.es] INFO: Saving data for RZ88845: {'auction_closing_time': 1769703127.0, 'created_time': 1769234439.358855, 'last_price_update_time': 1769620141.905501}
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RZ88845') HTTP/1.1" 204 0
2026-01-28 17:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 29f72eec-9aa6-59d7-996b-b2fc781708fa with identifier: EC42327
2026-01-28 17:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 29f72eec-9aa6-59d7-996b-b2fc781708fa with identifier: EC42327
2026-01-28 17:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 29f72eec-9aa6-59d7-996b-b2fc781708fa with identifier: EC42327 to the API
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EC42327>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:24:53Z',
 'fuel_type': 'hybrid',
 'id': '29f72eec-9aa6-59d7-996b-b2fc781708fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC42327',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 98972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 T4 4xe Plug-in Hybrid Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 2022}
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EC42327%27 HTTP/1.1" 200 None
2026-01-28 17:09:02 [auto1.es] INFO: Saving data for EC42327: {'auction_closing_time': 1769703893.0, 'created_time': 1769101654.560367, 'last_price_update_time': 1769620142.227468}
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EC42327') HTTP/1.1" 204 0
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_baf3234ee84bf41634666e8b92b46e75.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_339cc6b8310d07fbcea383360ddec61d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_1e6b40abe6025a7decf3e21bd59df652.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR69739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ21856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP80537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC57024> (referer: https://www.auto1.com/v1/car-details-view/JC57024/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6346de50>
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_2064d85f466cbc0785f27d884b308887.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_2064d85f466cbc0785f27d884b308887.jpg saved to cache
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636b1ad0>
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F08%252F2c08e68f4f5ab9b0acd548686484e930%252Fpa%252FLM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg saved to cache
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aef7cfe1-a898-5747-ae26-10b7a4775084
2026-01-28 17:09:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aef7cfe1-a898-5747-ae26-10b7a4775084, skipping ID generation
2026-01-28 17:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef7cfe1-a898-5747-ae26-10b7a4775084 with scrape type 1
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aef7cfe1-a898-5747-ae26-10b7a4775084 from tracking dictionaries
2026-01-28 17:09:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aef7cfe1-a898-5747-ae26-10b7a4775084 sending to next pipeline
2026-01-28 17:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aef7cfe1-a898-5747-ae26-10b7a4775084, identifier: LM22343
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269c090>
2026-01-28 17:09:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg saved to cache
2026-01-28 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aef7cfe1-a898-5747-ae26-10b7a4775084 with identifier: LM22343
2026-01-28 17:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aef7cfe1-a898-5747-ae26-10b7a4775084 with identifier: LM22343
2026-01-28 17:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: aef7cfe1-a898-5747-ae26-10b7a4775084 with identifier: LM22343 to the API
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-01-29T16:28:37Z',
 'fuel_type': 'petrol',
 'id': 'aef7cfe1-a898-5747-ae26-10b7a4775084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM22343',
 'listing': 'auction',
 'location': 'ES, Cornellà de Llobregat',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 77889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7a6d62ca3c1d056924bb00ca2d52f898.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_c5c130ce585028b2036f91fa22b15801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68875,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8e6e5d641f22bfd857de89f5bde570ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_2f7b7538c5ca231bbf17ba851bf0f58b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f7ba0ffa874e3a2de5cc876659e9498e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_7877a732dac7bfe879fc1ddc084706da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_51a723ac14265b35aefe8fdd48cf7b82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_0f13e35063bbf4f09339ccaffdc8d00a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_8d51ba1218b5589355f5e6a645937886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_f6774285b94bf5d4badffce4a9bebf58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_06c75a7e0e646a5ab5ddc864170f4b3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_3f862a41674ca425b4b12a0171f137b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_4282721c5a2904058351f59b26d19662.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_aa286105cbba46a72a632246fcbcba45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_e2327fc0ca1715c44d5e4c938aeea3af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aef7cfe1-a898-5747-ae26-10b7a4775084/aef7cfe1-a898-5747-ae26-10b7a4775084_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/08/2c08e68f4f5ab9b0acd548686484e930/pa/LM22343_d1be7f7a4b43d5046571401d2b726a75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Zenith 2WD',
 'transmission': 'manual',
 'trim': 'Zenith 2WD',
 'year': 2022}
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LM22343%27 HTTP/1.1" 200 None
2026-01-28 17:09:03 [auto1.es] INFO: Saving data for LM22343: {'created_time': 1769620143.537476, 'last_price_update_time': 1769620143.537488, 'auction_closing_time': 1769704117.0}
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LM22343') HTTP/1.1" 204 0
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_86e9dafd9834644077f90ebce3021f51.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN57329> (referer: https://www.auto1.com/v1/car-details-view/EN57329/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63363cd0>
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_baf3234ee84bf41634666e8b92b46e75.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_baf3234ee84bf41634666e8b92b46e75.jpg saved to cache
2026-01-28 17:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633d7650>
2026-01-28 17:09:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg saved to cache
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624f6090>
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_339cc6b8310d07fbcea383360ddec61d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_339cc6b8310d07fbcea383360ddec61d.jpg saved to cache
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a334d0>
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252F23%252Fcc2346f06258050a5003cddcab412d23%252Fpa%252FNN14393_1e6b40abe6025a7decf3e21bd59df652.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_1e6b40abe6025a7decf3e21bd59df652.jpg saved to cache
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad
2026-01-28 17:09:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad, skipping ID generation
2026-01-28 17:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad with scrape type 1
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad from tracking dictionaries
2026-01-28 17:09:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ebbf378-0f25-5a2a-a594-cf0c460b77ad sending to next pipeline
2026-01-28 17:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad, identifier: NN14393
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a53e10>
2026-01-28 17:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg saved to cache
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-01-28 17:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with scrape type 2
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with scrape type 2
2026-01-28 17:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8, identifier: JC57024
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625da0d0>
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fb2%252F91b285058c1e4ab72f07dc92e09b6b07%252Fpa%252FNP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg saved to cache
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a16794d2-8349-5e08-bc33-d940c6f7bf07
2026-01-28 17:09:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a16794d2-8349-5e08-bc33-d940c6f7bf07, skipping ID generation
2026-01-28 17:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a16794d2-8349-5e08-bc33-d940c6f7bf07 with scrape type 1
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a16794d2-8349-5e08-bc33-d940c6f7bf07 from tracking dictionaries
2026-01-28 17:09:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a16794d2-8349-5e08-bc33-d940c6f7bf07 sending to next pipeline
2026-01-28 17:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a16794d2-8349-5e08-bc33-d940c6f7bf07, identifier: NP31534
2026-01-28 17:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:05 [scrapy.extensions.logstats] INFO: Crawled 1167 pages (at 74 pages/min), scraped 315 items (at 20 items/min)
2026-01-28 17:09:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad with identifier: NN14393
2026-01-28 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad with identifier: NN14393
2026-01-28 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad spider: auto1.es
2026-01-28 17:09:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3ebbf378-0f25-5a2a-a594-cf0c460b77ad due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:12:35Z',
 'fuel_type': 'diesel',
 'id': '3ebbf378-0f25-5a2a-a594-cf0c460b77ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN14393',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 158836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_590c3c9165ecd158f48ffe9d16255c5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_fb666813d77efe4d99bee2b1592487ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_2c735a50384ec177b04afbc21b1780a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_63c88ff2693fa191d4395a29a4c2aa35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f9ef1f06b82f5181e7215bb4d74c565b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_1e6b40abe6025a7decf3e21bd59df652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c8e30031bfb9acf66441527b722c518d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_c7c02121dce294cff1ec614d955ee45e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_3ed89fde6fe9c81fe43fc3e7cb4cb180.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_263c8a86062c4edb1e5a9d4ea2867712.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_5a93cc098f3b764e30cd9ce76a4e4223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_f72812b8d5a03d856fd66e3384e04133.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_803e3a17746357ecd8f1dc488208a9a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_721dc791957a3655b69773b02823822c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_14048e20cd7c2b347283d7bbf222786f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3ebbf378-0f25-5a2a-a594-cf0c460b77ad/3ebbf378-0f25-5a2a-a594-cf0c460b77ad_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/23/cc2346f06258050a5003cddcab412d23/pa/NN14393_9d524479fb8d8372e394618e1d22c050.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi 20 Jahre Edition',
 'transmission': 'manual',
 'trim': '20 Jahre Edition',
 'year': 2017}
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN14393%27 HTTP/1.1" 200 None
2026-01-28 17:09:05 [auto1.es] INFO: Saving data for NN14393: {'created_time': 1769620145.851295, 'last_price_update_time': 1769620145.851305, 'auction_closing_time': 1769703155.0}
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN14393') HTTP/1.1" 204 0
2026-01-28 17:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-01-28 17:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024
2026-01-28 17:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 117ed6d3-0e34-5fb1-81da-bd7d060c23b8 with identifier: JC57024 to the API
2026-01-28 17:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC57024>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:49:31Z',
 'fuel_type': 'diesel',
 'id': '117ed6d3-0e34-5fb1-81da-bd7d060c23b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC57024',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 56678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2022}
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JC57024%27 HTTP/1.1" 200 None
2026-01-28 17:09:06 [auto1.es] INFO: Saving data for JC57024: {'auction_closing_time': 1769705371.0, 'created_time': 1769189040.85434, 'last_price_update_time': 1769620146.432042}
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JC57024') HTTP/1.1" 204 0
2026-01-28 17:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a16794d2-8349-5e08-bc33-d940c6f7bf07 with identifier: NP31534
2026-01-28 17:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a16794d2-8349-5e08-bc33-d940c6f7bf07 with identifier: NP31534
2026-01-28 17:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a16794d2-8349-5e08-bc33-d940c6f7bf07 with identifier: NP31534 to the API
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 136,
 'expiration_date': '2026-01-29T16:19:11Z',
 'fuel_type': 'diesel',
 'id': 'a16794d2-8349-5e08-bc33-d940c6f7bf07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP31534',
 'listing': 'auction',
 'location': 'ES, Alzira',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 43185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_9f12a828c75aac0eb46171144e694c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_771a5ee6b5bcd99b94b388747a3aafdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ef16a9bdb090ddfaf19e52b23d39a1c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_d9a1ec36b278e254d2b91090e4b37e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_e90736a1a0e7a3e93b94f012bdd2ca28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_dadd7ce95e6f9cb026d84ef00dcac18c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_be31beb80787acd961fd458f554396d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_2064d85f466cbc0785f27d884b308887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca6ae4ac56167c16425f2284521fb31a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_b02c066a0253f8d3097d778f32ad6ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_935dbe26c394d1886f99c61a2cfbd0f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_74fe96dd39715e779dfe5defbf98c4b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_17cff129a4f44e65389a9374195b3771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_38f9c802501512ef682d178faa957471.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_ca5b61e94b8641c7d0dff430b2d6337d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a16794d2-8349-5e08-bc33-d940c6f7bf07/a16794d2-8349-5e08-bc33-d940c6f7bf07_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/b2/91b285058c1e4ab72f07dc92e09b6b07/pa/NP31534_558059cf9514d8ccf152e0e84fb3b6ec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.6 CRDi Mild-Hybrid Tech',
 'transmission': 'manual',
 'trim': 'Tech',
 'year': 2021}
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NP31534%27 HTTP/1.1" 200 None
2026-01-28 17:09:06 [auto1.es] INFO: Saving data for NP31534: {'created_time': 1769620146.783838, 'last_price_update_time': 1769620146.783848, 'auction_closing_time': 1769703551.0}
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NP31534') HTTP/1.1" 204 0
2026-01-28 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB07340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR26127> (referer: https://www.auto1.com/v1/car-details-view/AR26127/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62457850>
2026-01-28 17:09:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fd0%252Fadd0319e88c029361e349796b92f4fcb%252Fpa%252FYC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg saved to cache
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba
2026-01-28 17:09:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba, skipping ID generation
2026-01-28 17:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with scrape type 1
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba from tracking dictionaries
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad27bcda-e4fa-583b-a65e-c3d854e6f9ba sending to next pipeline
2026-01-28 17:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba, identifier: YC11902
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b68348390>
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg saved to cache
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6299d750>
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg saved to cache
2026-01-28 17:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624572d0>
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_dd582612e87f83a5732545862adeac55.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg saved to cache
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629144d0>
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_33ef8d0e6791d1189e137a01a3032887.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg saved to cache
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62572d50>
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_86e9dafd9834644077f90ebce3021f51.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_86e9dafd9834644077f90ebce3021f51.jpg saved to cache
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14e96673-7375-5f50-8979-fe0601e2f059 with identifier: EN57329
2026-01-28 17:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14e96673-7375-5f50-8979-fe0601e2f059 with scrape type 2
2026-01-28 17:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14e96673-7375-5f50-8979-fe0601e2f059 with scrape type 2
2026-01-28 17:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 14e96673-7375-5f50-8979-fe0601e2f059, identifier: EN57329
2026-01-28 17:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with identifier: YC11902
2026-01-28 17:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with identifier: YC11902
2026-01-28 17:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ad27bcda-e4fa-583b-a65e-c3d854e6f9ba with identifier: YC11902 to the API
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:20:19Z',
 'fuel_type': 'petrol',
 'id': 'ad27bcda-e4fa-583b-a65e-c3d854e6f9ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC11902',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Kia',
 'model': 'Stonic',
 'odometer': 47898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_803bec5a0b71ff08137fbf105762ebdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_0e6f25d707260ebb534f3886205f07a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_673ff7a40d1328337dea599f29512fc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6031c446e523d02f8cbbc36e0434e8e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_baf3234ee84bf41634666e8b92b46e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_96cfaf0a198f4c26885fdfa8741a592b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_3d8804c4ad094443d72fa68da1d9d2f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_339cc6b8310d07fbcea383360ddec61d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_6dfdc765ce0ab7803bbc3c3b43594937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_e154b6512201b5145a9432e1e087e5f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_22fee5efac5d998de2ad94a4d2fc6d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_72fc86e113bc6ead350be8dc8086aa23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_b1793441685c1fd27d3965efecdc4f71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2cc89cf1ac9125a5758eb36d9e29ddc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_2898f89cb2ee2bfc73e33436a220555a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad27bcda-e4fa-583b-a65e-c3d854e6f9ba/ad27bcda-e4fa-583b-a65e-c3d854e6f9ba_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/d0/add0319e88c029361e349796b92f4fcb/pa/YC11902_8ad11925ad513901dda4e1d554ad5cbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Stonic 1.0 TGDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2022}
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC11902%27 HTTP/1.1" 200 None
2026-01-28 17:09:09 [auto1.es] INFO: Saving data for YC11902: {'created_time': 1769620149.015734, 'last_price_update_time': 1769620149.015745, 'auction_closing_time': 1769703619.0}
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC11902') HTTP/1.1" 204 0
2026-01-28 17:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 14e96673-7375-5f50-8979-fe0601e2f059 with identifier: EN57329
2026-01-28 17:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 14e96673-7375-5f50-8979-fe0601e2f059 with identifier: EN57329
2026-01-28 17:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 14e96673-7375-5f50-8979-fe0601e2f059 with identifier: EN57329 to the API
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EN57329>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:00:56Z',
 'fuel_type': 'petrol',
 'id': '14e96673-7375-5f50-8979-fe0601e2f059',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN57329',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 127170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-07',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN57329%27 HTTP/1.1" 200 None
2026-01-28 17:09:09 [auto1.es] INFO: Saving data for EN57329: {'auction_closing_time': 1769702456.0, 'created_time': 1769003121.807408, 'last_price_update_time': 1769620149.312807}
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN57329') HTTP/1.1" 204 0
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6265d410>
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_17b3ce58d3060551c02f32ab0afe0145.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg saved to cache
2026-01-28 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625cd0d0>
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg saved to cache
2026-01-28 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b3789a1-8563-5aea-a534-6ab2cc845607 with identifier: AR26127
2026-01-28 17:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b3789a1-8563-5aea-a534-6ab2cc845607 with scrape type 2
2026-01-28 17:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b3789a1-8563-5aea-a534-6ab2cc845607 with scrape type 2
2026-01-28 17:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 1b3789a1-8563-5aea-a534-6ab2cc845607, identifier: AR26127
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b69818d10>
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_610257c07d299998ea5291f56b72059e.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg saved to cache
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 1b3789a1-8563-5aea-a534-6ab2cc845607 with identifier: AR26127
2026-01-28 17:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 1b3789a1-8563-5aea-a534-6ab2cc845607 with identifier: AR26127
2026-01-28 17:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 1b3789a1-8563-5aea-a534-6ab2cc845607 spider: auto1.es
2026-01-28 17:09:10 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 1b3789a1-8563-5aea-a534-6ab2cc845607 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:17:47Z',
 'fuel_type': 'diesel',
 'id': '1b3789a1-8563-5aea-a534-6ab2cc845607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR26127',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 81733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-09',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2020}
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AR26127%27 HTTP/1.1" 200 None
2026-01-28 17:09:10 [auto1.es] INFO: Saving data for AR26127: {'auction_closing_time': 1769703467.0, 'created_time': 1768324489.871059, 'last_price_update_time': 1769620150.512879}
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AR26127') HTTP/1.1" 204 0
2026-01-28 17:09:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN27653/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6289f110>
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F9a%252F179a4af66e32806a14692bbb6031e0c7%252Fpa%252FYJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg saved to cache
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed285c3a-d9da-5e10-b30a-2219b5062946
2026-01-28 17:09:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed285c3a-d9da-5e10-b30a-2219b5062946, skipping ID generation
2026-01-28 17:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed285c3a-d9da-5e10-b30a-2219b5062946 with scrape type 1
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ed285c3a-d9da-5e10-b30a-2219b5062946 from tracking dictionaries
2026-01-28 17:09:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed285c3a-d9da-5e10-b30a-2219b5062946 sending to next pipeline
2026-01-28 17:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ed285c3a-d9da-5e10-b30a-2219b5062946, identifier: YJ38714
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62807d50>
2026-01-28 17:09:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg saved to cache
2026-01-28 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ed285c3a-d9da-5e10-b30a-2219b5062946 with identifier: YJ38714
2026-01-28 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ed285c3a-d9da-5e10-b30a-2219b5062946 with identifier: YJ38714
2026-01-28 17:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ed285c3a-d9da-5e10-b30a-2219b5062946 with identifier: YJ38714 to the API
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-01-29T16:47:09Z',
 'fuel_type': 'diesel',
 'id': 'ed285c3a-d9da-5e10-b30a-2219b5062946',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ38714',
 'listing': 'auction',
 'location': 'ES, Móstoles',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 108975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e78f536c23a799f21cb01d6088eee23a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_18c9b5498b957857e2a26389ffef0cc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107728,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_df41693b80d33064ca8ab982158ad7e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_4cd73c3f1cc24ffff8e80128690abaec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_104321ad15a9d8cdf3bfacee3ca967b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_3bfee604cc96e4046dd9ef4be0268166.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_86e9dafd9834644077f90ebce3021f51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_e2a11093fec38a95a7e05ada4b61013c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_92fcb6c7422ab5325f17b7b03856cb50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_cb3725d1073b453f41ab4222912c3c20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c043483b741c3d5fea44fe585125f334.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_c1ed4615e66ee5c686698022c2c5e36a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_81bc3a0c291a719e14a340b6176c84d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_393e01e0de2d89879dbabcb2e641a7cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_5519dcd581bbf1e58e96c6c57d1b1642.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed285c3a-d9da-5e10-b30a-2219b5062946/ed285c3a-d9da-5e10-b30a-2219b5062946_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/9a/179a4af66e32806a14692bbb6031e0c7/pa/YJ38714_606c93cc47101caef5ee819a7241008c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ38714%27 HTTP/1.1" 200 None
2026-01-28 17:09:11 [auto1.es] INFO: Saving data for YJ38714: {'created_time': 1769620151.561222, 'last_price_update_time': 1769620151.561233, 'auction_closing_time': 1769705229.0}
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ38714') HTTP/1.1" 204 0
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY35323> (referer: https://www.auto1.com/v1/car-details-view/EY35323/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX97052> (referer: https://www.auto1.com/v1/car-details-view/UX97052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK01872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AE99486> (referer: https://www.auto1.com/v1/car-details-view/AE99486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK53380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT91122> (referer: https://www.auto1.com/v1/car-details-view/UT91122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a47222-82cb-5e7d-9d06-36ba54d8a75b with identifier: EY35323
2026-01-28 17:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a47222-82cb-5e7d-9d06-36ba54d8a75b with scrape type 2
2026-01-28 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a47222-82cb-5e7d-9d06-36ba54d8a75b with scrape type 2
2026-01-28 17:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 53a47222-82cb-5e7d-9d06-36ba54d8a75b, identifier: EY35323
2026-01-28 17:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f0fdd2-dd01-507d-b01e-ee749658e0c4 with identifier: UX97052
2026-01-28 17:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4 with scrape type 1
2026-01-28 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_1e965932f2fa7547d875838863a38e09.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_1e965932f2fa7547d875838863a38e09.jpg not downloaded yet
2026-01-28 17:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 53a47222-82cb-5e7d-9d06-36ba54d8a75b with identifier: EY35323
2026-01-28 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 53a47222-82cb-5e7d-9d06-36ba54d8a75b with identifier: EY35323
2026-01-28 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
2026-01-28 17:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 53a47222-82cb-5e7d-9d06-36ba54d8a75b spider: auto1.es
2026-01-28 17:09:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 53a47222-82cb-5e7d-9d06-36ba54d8a75b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'tourneo custom' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:41:51Z',
 'fuel_type': 'diesel',
 'id': '53a47222-82cb-5e7d-9d06-36ba54d8a75b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY35323',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 47788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid L1 Trend',
 'transmission': 'manual',
 'trim': 'L1 Trend',
 'year': 2022}
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EY35323%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [auto1.es] INFO: Saving data for EY35323: {'auction_closing_time': 1769704911.0, 'created_time': 1768583035.91949, 'last_price_update_time': 1769620152.037765}
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EY35323') HTTP/1.1" 204 0
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg not downloaded yet
2026-01-28 17:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with identifier: AE99486
2026-01-28 17:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with scrape type 1
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg not downloaded yet
2026-01-28 17:09:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_fcd44d8e37582751f95fbdece259deea.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg not downloaded yet
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_917a4db133f89bef3bbdeb2491167ab0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_917a4db133f89bef3bbdeb2491167ab0.jpg not downloaded yet
2026-01-28 17:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81edd627-2aa4-5770-8292-cefa265a659e with identifier: UT91122
2026-01-28 17:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81edd627-2aa4-5770-8292-cefa265a659e with scrape type 2
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81edd627-2aa4-5770-8292-cefa265a659e with scrape type 2
2026-01-28 17:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 81edd627-2aa4-5770-8292-cefa265a659e, identifier: UT91122
2026-01-28 17:09:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6331d7d0>
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6f%252Fbf%252F6fbf6c6878ab59b7317f92c8a149a3c2%252Fpa%252FAY15178_07e39be48970e1f8b08586546bcf4c32.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg saved to cache
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c
2026-01-28 17:09:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c, skipping ID generation
2026-01-28 17:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c with scrape type 1
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c from tracking dictionaries
2026-01-28 17:09:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c sending to next pipeline
2026-01-28 17:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c, identifier: AY15178
2026-01-28 17:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 81edd627-2aa4-5770-8292-cefa265a659e with identifier: UT91122
2026-01-28 17:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 81edd627-2aa4-5770-8292-cefa265a659e with identifier: UT91122
2026-01-28 17:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 81edd627-2aa4-5770-8292-cefa265a659e with identifier: UT91122 to the API
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UT91122>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-01-29T16:26:22Z',
 'fuel_type': 'hybrid',
 'id': '81edd627-2aa4-5770-8292-cefa265a659e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT91122',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 40089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UT91122%27 HTTP/1.1" 200 None
2026-01-28 17:09:12 [auto1.es] INFO: Saving data for UT91122: {'auction_closing_time': 1769703982.0, 'created_time': 1769101639.1136, 'last_price_update_time': 1769620152.951686}
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UT91122') HTTP/1.1" 204 0
2026-01-28 17:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c with identifier: AY15178
2026-01-28 17:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c with identifier: AY15178
2026-01-28 17:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 70371, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay15178', 'expiration_date': '2026-01-29t16:51:46z', 'origin_country_code': 'es', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, valencia', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '9bba77b8-dc0e-56f4-a1a2-1e72c59b226c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 96725}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2148289}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80766}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2021894}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80908}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85636}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71357}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62307}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72244}], 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 70371}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': 'rental',
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:51:46z',
     'fuel_type': 'petrol',
     'id': '9bba77b8-dc0e-56f4-a1a2-1e72c59b226c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay15178',
     'listing': 'auction',
     'location': 'es, valencia',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 70371,
     'odometer_in_km': 70371,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 96725,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93886,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79800,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2148289,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67670,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80766,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2021894,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80908,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85636,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71357,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83981,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63470,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51820,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62307,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72244,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
2026-01-28 17:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c spider: auto1.es
2026-01-28 17:09:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 9bba77b8-dc0e-56f4-a1a2-1e72c59b226c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen c3 1.2 puretech feel', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'c3', 'transmission': 'manual', 'odometer': 70371, 'odometer_reading_unit': 'km', 'registration_date': '2018-05-27', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay15178', 'expiration_date': '2026-01-29t16:51:46z', 'origin_country_code': 'es', 'trim': 'feel', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, valencia', 'category': 'rental', 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 109, 'id': '9bba77b8-dc0e-56f4-a1a2-1e72c59b226c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 96725}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 93886}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2148289}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80766}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2021894}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 80908}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 85636}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71357}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83981}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63470}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 51820}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 62307}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 72244}], 'current_year_diff': 8, 'age_in_months': 92, 'make_model': 'citroen c3', 'sanitized_make': 'citroen', 'odometer_in_km': 70371}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 92,
     'auction_title': '',
     'c_o_2_emission_value': 109,
     'category': 'rental',
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:51:46z',
     'fuel_type': 'petrol',
     'id': '9bba77b8-dc0e-56f4-a1a2-1e72c59b226c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ay15178',
     'listing': 'auction',
     'location': 'es, valencia',
     'make': 'citroen',
     'make_model': 'citroen c3',
     'model': 'c3',
     'odometer': 70371,
     'odometer_in_km': 70371,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 96725,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 93886,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79800,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2148289,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67670,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80766,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2021894,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 80908,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 85636,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71357,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83981,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63470,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51820,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 62307,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72244,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-05-27',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen c3 1.2 puretech feel',
     'transmission': 'manual',
     'trim': 'feel',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:51:46Z',
 'fuel_type': 'petrol',
 'id': '9bba77b8-dc0e-56f4-a1a2-1e72c59b226c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY15178',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 70371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_31157fec922e3b26fd8a251b54d771cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_b6fc5e8ccd764a22e099ecaef67a9833.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_229b4b0c68ab683e863351d4dfbdd1b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2148289,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_0cacb266f8f36166d57380beb98e0676.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_53c43b35a6ebcc4efc73747a8f9a4c66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_610257c07d299998ea5291f56b72059e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2021894,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_07e39be48970e1f8b08586546bcf4c32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_17b3ce58d3060551c02f32ab0afe0145.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_33ef8d0e6791d1189e137a01a3032887.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_dd582612e87f83a5732545862adeac55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cfd2b395f58ab767a016beffcfcae8e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_7d5a6775cee990e01c07e53434cf82c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_88618bd5faed7dc77516b8114c8042b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_222c159de2a109f38e771d233f9361ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_9e94c78bfa291f81b0b1fc370e0b58d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bba77b8-dc0e-56f4-a1a2-1e72c59b226c/9bba77b8-dc0e-56f4-a1a2-1e72c59b226c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6f/bf/6fbf6c6878ab59b7317f92c8a149a3c2/pa/AY15178_cdca13368d4e9463c93be156d7227415.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AY15178%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [auto1.es] INFO: Saving data for AY15178: {'created_time': 1769620153.193439, 'last_price_update_time': 1769620153.193451, 'auction_closing_time': 1769705506.0}
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AY15178') HTTP/1.1" 204 0
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_e703890e5987633708f516fba5c17841.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e703890e5987633708f516fba5c17841.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_91edab15e3261f22bb561d46574539a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_91edab15e3261f22bb561d46574539a2.jpg not downloaded yet
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB61319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS85202/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634f6550>
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_fcd44d8e37582751f95fbdece259deea.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_fcd44d8e37582751f95fbdece259deea.jpg saved to cache
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_e339ee7c96684346970fe7784716779a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e339ee7c96684346970fe7784716779a.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg not downloaded yet
2026-01-28 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_abaedd09928149ff52394d55d0326512.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_abaedd09928149ff52394d55d0326512.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_74434adda29d8bba94134d39da5ee00d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_74434adda29d8bba94134d39da5ee00d.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_3c11e18320024c24daed0da70b721842.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3c11e18320024c24daed0da70b721842.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c5732464f25c3ec5163b87f3385eb226.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c5732464f25c3ec5163b87f3385eb226.jpg not downloaded yet
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW26445/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_d542f733011c92cecfdb12da5690af26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_d542f733011c92cecfdb12da5690af26.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c0e83fe9ae724efbb30080932fed30d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c0e83fe9ae724efbb30080932fed30d5.jpg not downloaded yet
2026-01-28 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_8348bde31be3511eb3b915a66253afde.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8348bde31be3511eb3b915a66253afde.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg not downloaded yet
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e703890e5987633708f516fba5c17841.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_895c974f9918842c149bd434033e6ac5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_895c974f9918842c149bd434033e6ac5.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c615b8dfc9089f9077fc4de14e865560.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c615b8dfc9089f9077fc4de14e865560.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_127288840bf1592821c31c496aeb0f3b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_127288840bf1592821c31c496aeb0f3b.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_3f369d1311483a5e73c795a66520ca22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3f369d1311483a5e73c795a66520ca22.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_03511d412289283e5fda15a55a3c12e7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_03511d412289283e5fda15a55a3c12e7.jpg not downloaded yet
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_91edab15e3261f22bb561d46574539a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_982e32eb9f31e58352747a71f5c37636.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_982e32eb9f31e58352747a71f5c37636.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg not downloaded yet
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EV17776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU00551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_0517403e71b3581e70a0bb3fe4806810.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_0517403e71b3581e70a0bb3fe4806810.jpg not downloaded yet
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_15d156428ddfbfe172fee6e25359a080.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_15d156428ddfbfe172fee6e25359a080.jpg not downloaded yet
2026-01-28 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aad390>
2026-01-28 17:09:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_e703890e5987633708f516fba5c17841.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e703890e5987633708f516fba5c17841.jpg saved to cache
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c5732464f25c3ec5163b87f3385eb226.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg not downloaded yet
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_03511d412289283e5fda15a55a3c12e7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ21856> (referer: https://www.auto1.com/v1/car-details-view/YJ21856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR69739> (referer: https://www.auto1.com/v1/car-details-view/KR69739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP80537> (referer: https://www.auto1.com/v1/car-details-view/UP80537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63488a50>
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_91edab15e3261f22bb561d46574539a2.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_91edab15e3261f22bb561d46574539a2.jpg saved to cache
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_15d156428ddfbfe172fee6e25359a080.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_0517403e71b3581e70a0bb3fe4806810.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63698790>
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c5732464f25c3ec5163b87f3385eb226.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c5732464f25c3ec5163b87f3385eb226.jpg saved to cache
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6358f650>
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg saved to cache
2026-01-28 17:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a678d0>
2026-01-28 17:09:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_03511d412289283e5fda15a55a3c12e7.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_03511d412289283e5fda15a55a3c12e7.jpg saved to cache
2026-01-28 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e3cff5-a59d-5157-b7e0-b80376518c77 with identifier: YJ21856
2026-01-28 17:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e3cff5-a59d-5157-b7e0-b80376518c77 with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0e3cff5-a59d-5157-b7e0-b80376518c77 with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c0e3cff5-a59d-5157-b7e0-b80376518c77, identifier: YJ21856
2026-01-28 17:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with identifier: KR69739
2026-01-28 17:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b, identifier: KR69739
2026-01-28 17:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f60cc6a6-c4b4-563d-ac2c-157a1b2191da with identifier: UP80537
2026-01-28 17:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f60cc6a6-c4b4-563d-ac2c-157a1b2191da with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f60cc6a6-c4b4-563d-ac2c-157a1b2191da with scrape type 2
2026-01-28 17:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f60cc6a6-c4b4-563d-ac2c-157a1b2191da, identifier: UP80537
2026-01-28 17:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c0e3cff5-a59d-5157-b7e0-b80376518c77 with identifier: YJ21856
2026-01-28 17:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c0e3cff5-a59d-5157-b7e0-b80376518c77 with identifier: YJ21856
2026-01-28 17:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
2026-01-28 17:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: c0e3cff5-a59d-5157-b7e0-b80376518c77 spider: auto1.es
2026-01-28 17:09:15 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c0e3cff5-a59d-5157-b7e0-b80376518c77 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'fiorino' containing 'fiorino'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:54:49Z',
 'fuel_type': 'diesel',
 'id': 'c0e3cff5-a59d-5157-b7e0-b80376518c77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21856',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 102942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-20',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 M-Jet SX Kasten',
 'transmission': 'manual',
 'trim': 'SX Kasten',
 'year': 2021}
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YJ21856%27 HTTP/1.1" 200 None
2026-01-28 17:09:15 [auto1.es] INFO: Saving data for YJ21856: {'auction_closing_time': 1769705689.0, 'created_time': 1769188201.042049, 'last_price_update_time': 1769620155.785746}
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YJ21856') HTTP/1.1" 204 0
2026-01-28 17:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with identifier: KR69739
2026-01-28 17:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with identifier: KR69739
2026-01-28 17:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b with identifier: KR69739 to the API
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KR69739>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:03:20Z',
 'fuel_type': 'hybrid',
 'id': 'b7d316c0-ac2c-5906-8ac8-92d5d9f51d7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR69739',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 72425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid AWD-i Adventure',
 'transmission': 'automatic',
 'trim': 'AWD-i Adventure',
 'year': 2021}
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KR69739%27 HTTP/1.1" 200 None
2026-01-28 17:09:16 [auto1.es] INFO: Saving data for KR69739: {'auction_closing_time': 1769702600.0, 'created_time': 1769234498.134292, 'last_price_update_time': 1769620156.245139}
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KR69739') HTTP/1.1" 204 0
2026-01-28 17:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f60cc6a6-c4b4-563d-ac2c-157a1b2191da with identifier: UP80537
2026-01-28 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f60cc6a6-c4b4-563d-ac2c-157a1b2191da with identifier: UP80537
2026-01-28 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 189645 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189645
2026-01-28 17:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f60cc6a6-c4b4-563d-ac2c-157a1b2191da spider: auto1.es
2026-01-28 17:09:16 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f60cc6a6-c4b4-563d-ac2c-157a1b2191da due to rule: high_mileage_for_country.json, error: 189645 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    189645
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:54:46Z',
 'fuel_type': 'diesel',
 'id': 'f60cc6a6-c4b4-563d-ac2c-157a1b2191da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP80537',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 189645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2021}
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UP80537%27 HTTP/1.1" 200 None
2026-01-28 17:09:16 [auto1.es] INFO: Saving data for UP80537: {'auction_closing_time': 1769705686.0, 'created_time': 1769188154.859018, 'last_price_update_time': 1769620156.520625}
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UP80537') HTTP/1.1" 204 0
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3f369d1311483a5e73c795a66520ca22.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_982e32eb9f31e58352747a71f5c37636.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW76363/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG21030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA81137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB07340> (referer: https://www.auto1.com/v1/car-details-view/MB07340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN27653> (referer: https://www.auto1.com/v1/car-details-view/EN27653/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62888050>
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg saved to cache
2026-01-28 17:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62703a50>
2026-01-28 17:09:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_15d156428ddfbfe172fee6e25359a080.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_15d156428ddfbfe172fee6e25359a080.jpg saved to cache
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a63990>
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_0517403e71b3581e70a0bb3fe4806810.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_0517403e71b3581e70a0bb3fe4806810.jpg saved to cache
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_127288840bf1592821c31c496aeb0f3b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6270a310>
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_3f369d1311483a5e73c795a66520ca22.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3f369d1311483a5e73c795a66520ca22.jpg saved to cache
2026-01-28 17:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a51e50>
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg saved to cache
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624a9810>
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_982e32eb9f31e58352747a71f5c37636.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_982e32eb9f31e58352747a71f5c37636.jpg saved to cache
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626c6250>
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg saved to cache
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01cc3577-356a-51ef-96d3-ce390a4521dc with identifier: MB07340
2026-01-28 17:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01cc3577-356a-51ef-96d3-ce390a4521dc with scrape type 2
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01cc3577-356a-51ef-96d3-ce390a4521dc with scrape type 2
2026-01-28 17:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 01cc3577-356a-51ef-96d3-ce390a4521dc, identifier: MB07340
2026-01-28 17:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aad4056b-ec4d-510c-ae7e-87e5a54100a1 with identifier: EN27653
2026-01-28 17:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aad4056b-ec4d-510c-ae7e-87e5a54100a1 with scrape type 2
2026-01-28 17:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aad4056b-ec4d-510c-ae7e-87e5a54100a1 with scrape type 2
2026-01-28 17:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: aad4056b-ec4d-510c-ae7e-87e5a54100a1, identifier: EN27653
2026-01-28 17:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_895c974f9918842c149bd434033e6ac5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 01cc3577-356a-51ef-96d3-ce390a4521dc with identifier: MB07340
2026-01-28 17:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 01cc3577-356a-51ef-96d3-ce390a4521dc with identifier: MB07340
2026-01-28 17:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 01cc3577-356a-51ef-96d3-ce390a4521dc with identifier: MB07340 to the API
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB07340>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '',
 'engine_horse_power': 8,
 'expiration_date': '2026-01-29T16:01:50Z',
 'fuel_type': 'electro',
 'id': '01cc3577-356a-51ef-96d3-ce390a4521dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB07340',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Ami',
 'odometer': 21524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Ami electric drive 6 kW My Ami Pop',
 'transmission': 'automatic',
 'trim': 'My  Pop',
 'year': 2022}
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MB07340%27 HTTP/1.1" 200 None
2026-01-28 17:09:19 [auto1.es] INFO: Saving data for MB07340: {'auction_closing_time': 1769702510.0, 'created_time': 1769002975.237792, 'last_price_update_time': 1769620159.011077}
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MB07340') HTTP/1.1" 204 0
2026-01-28 17:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: aad4056b-ec4d-510c-ae7e-87e5a54100a1 with identifier: EN27653
2026-01-28 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: aad4056b-ec4d-510c-ae7e-87e5a54100a1 with identifier: EN27653
2026-01-28 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168489 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168489
2026-01-28 17:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: aad4056b-ec4d-510c-ae7e-87e5a54100a1 spider: auto1.es
2026-01-28 17:09:19 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: aad4056b-ec4d-510c-ae7e-87e5a54100a1 due to rule: high_mileage_for_country.json, error: 168489 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168489
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:49:13Z',
 'fuel_type': 'diesel',
 'id': 'aad4056b-ec4d-510c-ae7e-87e5a54100a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN27653',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 168489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2020}
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EN27653%27 HTTP/1.1" 200 None
2026-01-28 17:09:19 [auto1.es] INFO: Saving data for EN27653: {'auction_closing_time': 1769705353.0, 'created_time': 1769148211.52451, 'last_price_update_time': 1769620159.251956}
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EN27653') HTTP/1.1" 204 0
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8348bde31be3511eb3b915a66253afde.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c615b8dfc9089f9077fc4de14e865560.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c0e83fe9ae724efbb30080932fed30d5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_d542f733011c92cecfdb12da5690af26.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3c11e18320024c24daed0da70b721842.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK53380> (referer: https://www.auto1.com/v1/car-details-view/GK53380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT82047/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635d81d0>
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_127288840bf1592821c31c496aeb0f3b.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_127288840bf1592821c31c496aeb0f3b.jpg saved to cache
2026-01-28 17:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62408590>
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_895c974f9918842c149bd434033e6ac5.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_895c974f9918842c149bd434033e6ac5.jpg saved to cache
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_74434adda29d8bba94134d39da5ee00d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV25666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62705f90>
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_8348bde31be3511eb3b915a66253afde.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8348bde31be3511eb3b915a66253afde.jpg saved to cache
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63465450>
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c615b8dfc9089f9077fc4de14e865560.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c615b8dfc9089f9077fc4de14e865560.jpg saved to cache
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b69749850>
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_c0e83fe9ae724efbb30080932fed30d5.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c0e83fe9ae724efbb30080932fed30d5.jpg saved to cache
2026-01-28 17:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633323d0>
2026-01-28 17:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg saved to cache
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62693350>
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_d542f733011c92cecfdb12da5690af26.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_d542f733011c92cecfdb12da5690af26.jpg saved to cache
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629daf10>
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg saved to cache
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63541fd0>
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_3c11e18320024c24daed0da70b721842.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3c11e18320024c24daed0da70b721842.jpg saved to cache
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-01-28 17:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41e0fa5-066a-51ce-9f57-95bce19e95f4 with scrape type 2
2026-01-28 17:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41e0fa5-066a-51ce-9f57-95bce19e95f4 with scrape type 2
2026-01-28 17:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a41e0fa5-066a-51ce-9f57-95bce19e95f4, identifier: GK53380
2026-01-28 17:09:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-01-28 17:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 with identifier: GK53380
2026-01-28 17:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 135100 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135100
2026-01-28 17:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a41e0fa5-066a-51ce-9f57-95bce19e95f4 spider: auto1.es
2026-01-28 17:09:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a41e0fa5-066a-51ce-9f57-95bce19e95f4 due to rule: high_mileage_for_make.json, error: 135100 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    135100
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:44:20Z',
 'fuel_type': 'diesel',
 'id': 'a41e0fa5-066a-51ce-9f57-95bce19e95f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK53380',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 135100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque D150 Mild-Hybrid S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2020}
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GK53380%27 HTTP/1.1" 200 None
2026-01-28 17:09:22 [auto1.es] INFO: Saving data for GK53380: {'auction_closing_time': 1769705060.0, 'created_time': 1768324276.385205, 'last_price_update_time': 1769620162.160807}
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GK53380') HTTP/1.1" 204 0
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e339ee7c96684346970fe7784716779a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_abaedd09928149ff52394d55d0326512.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_917a4db133f89bef3bbdeb2491167ab0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EV17776> (referer: https://www.auto1.com/v1/car-details-view/EV17776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW26445> (referer: https://www.auto1.com/v1/car-details-view/CW26445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU00551> (referer: https://www.auto1.com/v1/car-details-view/JU00551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627874d0>
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg saved to cache
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a11790>
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_74434adda29d8bba94134d39da5ee00d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_74434adda29d8bba94134d39da5ee00d.jpg saved to cache
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625cf710>
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg saved to cache
2026-01-28 17:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624aa650>
2026-01-28 17:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_e339ee7c96684346970fe7784716779a.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e339ee7c96684346970fe7784716779a.jpg saved to cache
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629dd590>
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_abaedd09928149ff52394d55d0326512.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_abaedd09928149ff52394d55d0326512.jpg saved to cache
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a2f250>
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg saved to cache
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62637450>
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_917a4db133f89bef3bbdeb2491167ab0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_917a4db133f89bef3bbdeb2491167ab0.jpg saved to cache
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e53b2a-85d0-58ca-82a8-09573dfb23c1 with identifier: EV17776
2026-01-28 17:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e53b2a-85d0-58ca-82a8-09573dfb23c1 with scrape type 2
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e53b2a-85d0-58ca-82a8-09573dfb23c1 with scrape type 2
2026-01-28 17:09:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 04e53b2a-85d0-58ca-82a8-09573dfb23c1, identifier: EV17776
2026-01-28 17:09:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 238fb2e7-2e3c-5a26-a43b-11284cf5900e with identifier: CW26445
2026-01-28 17:09:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 238fb2e7-2e3c-5a26-a43b-11284cf5900e with scrape type 2
2026-01-28 17:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 238fb2e7-2e3c-5a26-a43b-11284cf5900e with scrape type 2
2026-01-28 17:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 238fb2e7-2e3c-5a26-a43b-11284cf5900e, identifier: CW26445
2026-01-28 17:09:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94556a12-f0b4-5ce8-b189-7b65c0935f55 with identifier: JU00551
2026-01-28 17:09:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94556a12-f0b4-5ce8-b189-7b65c0935f55 with scrape type 2
2026-01-28 17:09:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94556a12-f0b4-5ce8-b189-7b65c0935f55 with scrape type 2
2026-01-28 17:09:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 94556a12-f0b4-5ce8-b189-7b65c0935f55, identifier: JU00551
2026-01-28 17:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 04e53b2a-85d0-58ca-82a8-09573dfb23c1 with identifier: EV17776
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 04e53b2a-85d0-58ca-82a8-09573dfb23c1 with identifier: EV17776
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 04e53b2a-85d0-58ca-82a8-09573dfb23c1 spider: auto1.es
2026-01-28 17:09:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 04e53b2a-85d0-58ca-82a8-09573dfb23c1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:32:56Z',
 'fuel_type': 'diesel',
 'id': '04e53b2a-85d0-58ca-82a8-09573dfb23c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV17776',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 118966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EV17776%27 HTTP/1.1" 200 None
2026-01-28 17:09:24 [auto1.es] INFO: Saving data for EV17776: {'auction_closing_time': 1769704376.0, 'created_time': 1768401411.641127, 'last_price_update_time': 1769620164.389065}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EV17776') HTTP/1.1" 204 0
2026-01-28 17:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 238fb2e7-2e3c-5a26-a43b-11284cf5900e with identifier: CW26445
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 238fb2e7-2e3c-5a26-a43b-11284cf5900e with identifier: CW26445
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 238fb2e7-2e3c-5a26-a43b-11284cf5900e spider: auto1.es
2026-01-28 17:09:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 238fb2e7-2e3c-5a26-a43b-11284cf5900e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:40:04Z',
 'fuel_type': 'diesel',
 'id': '238fb2e7-2e3c-5a26-a43b-11284cf5900e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW26445',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 169922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-26',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CW26445%27 HTTP/1.1" 200 None
2026-01-28 17:09:24 [auto1.es] INFO: Saving data for CW26445: {'auction_closing_time': 1769704804.0, 'created_time': 1768323825.442034, 'last_price_update_time': 1769620164.611517}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CW26445') HTTP/1.1" 204 0
2026-01-28 17:09:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 94556a12-f0b4-5ce8-b189-7b65c0935f55 with identifier: JU00551
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 94556a12-f0b4-5ce8-b189-7b65c0935f55 with identifier: JU00551
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:09:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 94556a12-f0b4-5ce8-b189-7b65c0935f55 spider: auto1.es
2026-01-28 17:09:24 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 94556a12-f0b4-5ce8-b189-7b65c0935f55 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:53:36Z',
 'fuel_type': 'diesel',
 'id': '94556a12-f0b4-5ce8-b189-7b65c0935f55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU00551',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 109785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Pro L2',
 'transmission': 'manual',
 'trim': 'Pro L2',
 'year': 2020}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU00551%27 HTTP/1.1" 200 None
2026-01-28 17:09:24 [auto1.es] INFO: Saving data for JU00551: {'auction_closing_time': 1769705616.0, 'created_time': 1768401407.535739, 'last_price_update_time': 1769620164.852316}
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JU00551') HTTP/1.1" 204 0
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_1e965932f2fa7547d875838863a38e09.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_de34e390c630a001622dcf80eb547291.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG21030> (referer: https://www.auto1.com/v1/car-details-view/AG21030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS85202> (referer: https://www.auto1.com/v1/car-details-view/DS85202/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA81137> (referer: https://www.auto1.com/v1/car-details-view/NA81137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW76363> (referer: https://www.auto1.com/v1/car-details-view/NW76363/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634bf210>
2026-01-28 17:09:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg saved to cache
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624579d0>
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7f%252F877f15de668c82c21b28bdd441a19def%252Fpa%252FAE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg saved to cache
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7
2026-01-28 17:09:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7, skipping ID generation
2026-01-28 17:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with scrape type 1
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 from tracking dictionaries
2026-01-28 17:09:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 sending to next pipeline
2026-01-28 17:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7, identifier: AE99486
2026-01-28 17:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with identifier: AE99486
2026-01-28 17:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with identifier: AE99486
2026-01-28 17:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 274b2fc5-c648-5d37-b5c9-6b3cb587c4f7 with identifier: AE99486 to the API
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-01-29T16:46:16Z',
 'fuel_type': 'petrol',
 'id': '274b2fc5-c648-5d37-b5c9-6b3cb587c4f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE99486',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 28899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_52332a13cc26c80f8e5efb2d9c92daa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_917a4db133f89bef3bbdeb2491167ab0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_91edab15e3261f22bb561d46574539a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_6c80692018be0f6c6784c40fd1a28ac0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_923e6b469d7dc3d2767956bcd8b105b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_74434adda29d8bba94134d39da5ee00d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_90c4791171f3422b5dc64b5ddd3f4790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c5732464f25c3ec5163b87f3385eb226.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c0e83fe9ae724efbb30080932fed30d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_b5ce4a0d9c650258fdcafa2a79d4a495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_c615b8dfc9089f9077fc4de14e865560.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_bdf3cc6c84e04953d101b35a1a5173bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_03511d412289283e5fda15a55a3c12e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_94532c2bf624ec751a7ecf764eae4c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_15d156428ddfbfe172fee6e25359a080.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_274b2fc5-c648-5d37-b5c9-6b3cb587c4f7/274b2fc5-c648-5d37-b5c9-6b3cb587c4f7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7f/877f15de668c82c21b28bdd441a19def/pa/AE99486_f9e5df97d22e1e6ac2eb8d48705f518e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST',
 'transmission': 'automatic',
 'trim': 'ST',
 'year': 2024}
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AE99486%27 HTTP/1.1" 200 None
2026-01-28 17:09:26 [auto1.es] INFO: Saving data for AE99486: {'created_time': 1769620166.008963, 'last_price_update_time': 1769620166.008974, 'auction_closing_time': 1769705176.0}
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AE99486') HTTP/1.1" 204 0
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344ce10>
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_1e965932f2fa7547d875838863a38e09.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_1e965932f2fa7547d875838863a38e09.jpg saved to cache
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634d3550>
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252Fc2%252F9cc2610944a5a598b04f682b42bd1977%252Fpa%252FUX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg saved to cache
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4
2026-01-28 17:09:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5f0fdd2-dd01-507d-b01e-ee749658e0c4, skipping ID generation
2026-01-28 17:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4 with scrape type 1
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c5f0fdd2-dd01-507d-b01e-ee749658e0c4 from tracking dictionaries
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5f0fdd2-dd01-507d-b01e-ee749658e0c4 sending to next pipeline
2026-01-28 17:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: c5f0fdd2-dd01-507d-b01e-ee749658e0c4, identifier: UX97052
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62754cd0>
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_de34e390c630a001622dcf80eb547291.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_de34e390c630a001622dcf80eb547291.jpg saved to cache
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4374b5a3-03e9-519d-9cce-e26f606b4e97 with identifier: AG21030
2026-01-28 17:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4374b5a3-03e9-519d-9cce-e26f606b4e97 with scrape type 2
2026-01-28 17:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4374b5a3-03e9-519d-9cce-e26f606b4e97 with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4374b5a3-03e9-519d-9cce-e26f606b4e97, identifier: AG21030
2026-01-28 17:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c6d895a-4f60-5fde-bdeb-165848e9ab31 with identifier: DS85202
2026-01-28 17:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c6d895a-4f60-5fde-bdeb-165848e9ab31 with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c6d895a-4f60-5fde-bdeb-165848e9ab31 with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5c6d895a-4f60-5fde-bdeb-165848e9ab31, identifier: DS85202
2026-01-28 17:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f with identifier: NA81137
2026-01-28 17:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef0b2db-d94e-553b-b3d7-6e0bf9ab705f with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef0b2db-d94e-553b-b3d7-6e0bf9ab705f with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f, identifier: NA81137
2026-01-28 17:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15a71107-60e7-5e1a-9809-59e1986aaa10 with identifier: NW76363
2026-01-28 17:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15a71107-60e7-5e1a-9809-59e1986aaa10 with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15a71107-60e7-5e1a-9809-59e1986aaa10 with scrape type 2
2026-01-28 17:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15a71107-60e7-5e1a-9809-59e1986aaa10, identifier: NW76363
2026-01-28 17:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: c5f0fdd2-dd01-507d-b01e-ee749658e0c4 with identifier: UX97052
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: c5f0fdd2-dd01-507d-b01e-ee749658e0c4 with identifier: UX97052
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 197485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197485
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c5f0fdd2-dd01-507d-b01e-ee749658e0c4 spider: auto1.es
2026-01-28 17:09:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: c5f0fdd2-dd01-507d-b01e-ee749658e0c4 due to rule: high_mileage_for_country.json, error: 197485 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    197485
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:05:23Z',
 'fuel_type': 'diesel',
 'id': 'c5f0fdd2-dd01-507d-b01e-ee749658e0c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX97052',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 197485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_1e965932f2fa7547d875838863a38e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_a4f3ada06c7d127cac2ff020d9797c34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8e02c2e4afc257ddfd1fa9ba7efd18fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e703890e5987633708f516fba5c17841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_e339ee7c96684346970fe7784716779a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_abaedd09928149ff52394d55d0326512.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_bd9fa49d83a7591f3b57a4562ebe9bde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3c11e18320024c24daed0da70b721842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_21596ad9176ceb4eb4365d6cc8c99ae8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_d542f733011c92cecfdb12da5690af26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_8348bde31be3511eb3b915a66253afde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_895c974f9918842c149bd434033e6ac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_127288840bf1592821c31c496aeb0f3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_3f369d1311483a5e73c795a66520ca22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_982e32eb9f31e58352747a71f5c37636.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f0fdd2-dd01-507d-b01e-ee749658e0c4/c5f0fdd2-dd01-507d-b01e-ee749658e0c4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/c2/9cc2610944a5a598b04f682b42bd1977/pa/UX97052_0517403e71b3581e70a0bb3fe4806810.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-12',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UX97052%27 HTTP/1.1" 200 None
2026-01-28 17:09:27 [auto1.es] INFO: Saving data for UX97052: {'created_time': 1769620167.557039, 'last_price_update_time': 1769620167.557049, 'auction_closing_time': 1769702723.0}
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UX97052') HTTP/1.1" 204 0
2026-01-28 17:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4374b5a3-03e9-519d-9cce-e26f606b4e97 with identifier: AG21030
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4374b5a3-03e9-519d-9cce-e26f606b4e97 with identifier: AG21030
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158406 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158406
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4374b5a3-03e9-519d-9cce-e26f606b4e97 spider: auto1.es
2026-01-28 17:09:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 4374b5a3-03e9-519d-9cce-e26f606b4e97 due to rule: high_mileage_for_country.json, error: 158406 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158406
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:35:01Z',
 'fuel_type': 'diesel',
 'id': '4374b5a3-03e9-519d-9cce-e26f606b4e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG21030',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 158406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AG21030%27 HTTP/1.1" 200 None
2026-01-28 17:09:27 [auto1.es] INFO: Saving data for AG21030: {'auction_closing_time': 1769704501.0, 'created_time': 1768401757.320742, 'last_price_update_time': 1769620167.792711}
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AG21030') HTTP/1.1" 204 0
2026-01-28 17:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5c6d895a-4f60-5fde-bdeb-165848e9ab31 with identifier: DS85202
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5c6d895a-4f60-5fde-bdeb-165848e9ab31 with identifier: DS85202
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
2026-01-28 17:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5c6d895a-4f60-5fde-bdeb-165848e9ab31 spider: auto1.es
2026-01-28 17:09:27 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5c6d895a-4f60-5fde-bdeb-165848e9ab31 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:07:44Z',
 'fuel_type': 'diesel',
 'id': '5c6d895a-4f60-5fde-bdeb-165848e9ab31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS85202',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 136246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-16',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Jumpy 1.5 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2020}
2026-01-28 17:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DS85202%27 HTTP/1.1" 200 None
2026-01-28 17:09:28 [auto1.es] INFO: Saving data for DS85202: {'auction_closing_time': 1769702864.0, 'created_time': 1769188252.372771, 'last_price_update_time': 1769620168.001879}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DS85202') HTTP/1.1" 204 0
2026-01-28 17:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f with identifier: NA81137
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f with identifier: NA81137
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178625
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f spider: auto1.es
2026-01-28 17:09:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bef0b2db-d94e-553b-b3d7-6e0bf9ab705f due to rule: high_mileage_for_country.json, error: 178625 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178625
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-01-29T16:20:57Z',
 'fuel_type': 'petrol',
 'id': 'bef0b2db-d94e-553b-b3d7-6e0bf9ab705f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA81137',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 178625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NA81137%27 HTTP/1.1" 200 None
2026-01-28 17:09:28 [auto1.es] INFO: Saving data for NA81137: {'auction_closing_time': 1769703657.0, 'created_time': 1769447409.99548, 'last_price_update_time': 1769620168.221395}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NA81137') HTTP/1.1" 204 0
2026-01-28 17:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15a71107-60e7-5e1a-9809-59e1986aaa10 with identifier: NW76363
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15a71107-60e7-5e1a-9809-59e1986aaa10 with identifier: NW76363
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157319 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157319
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 15a71107-60e7-5e1a-9809-59e1986aaa10 spider: auto1.es
2026-01-28 17:09:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 15a71107-60e7-5e1a-9809-59e1986aaa10 due to rule: high_mileage_for_country.json, error: 157319 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157319
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:53:49Z',
 'fuel_type': 'petrol',
 'id': '15a71107-60e7-5e1a-9809-59e1986aaa10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW76363',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 157319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-07-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NW76363%27 HTTP/1.1" 200 None
2026-01-28 17:09:28 [auto1.es] INFO: Saving data for NW76363: {'auction_closing_time': 1769705629.0, 'created_time': 1768401557.809722, 'last_price_update_time': 1769620168.472824}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NW76363') HTTP/1.1" 204 0
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK01872> (referer: https://www.auto1.com/v1/car-details-view/EK01872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD98526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT82047> (referer: https://www.auto1.com/v1/car-details-view/HT82047/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB61319> (referer: https://www.auto1.com/v1/car-details-view/VB61319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e980479-e290-5e3c-8026-b26a8d2b1673 with identifier: EK01872
2026-01-28 17:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e980479-e290-5e3c-8026-b26a8d2b1673 with scrape type 2
2026-01-28 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e980479-e290-5e3c-8026-b26a8d2b1673 with scrape type 2
2026-01-28 17:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2e980479-e290-5e3c-8026-b26a8d2b1673, identifier: EK01872
2026-01-28 17:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2e980479-e290-5e3c-8026-b26a8d2b1673 with identifier: EK01872
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2e980479-e290-5e3c-8026-b26a8d2b1673 with identifier: EK01872
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2026-01-28 17:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 2e980479-e290-5e3c-8026-b26a8d2b1673 spider: auto1.es
2026-01-28 17:09:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2e980479-e290-5e3c-8026-b26a8d2b1673 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:51:10Z',
 'fuel_type': 'diesel',
 'id': '2e980479-e290-5e3c-8026-b26a8d2b1673',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK01872',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'ProAce City',
 'odometer': 149711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota ProAce City 1.5 D-4D Combi L1 GX',
 'transmission': 'manual',
 'trim': 'Combi L1 GX',
 'year': 2020}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EK01872%27 HTTP/1.1" 200 None
2026-01-28 17:09:28 [auto1.es] INFO: Saving data for EK01872: {'auction_closing_time': 1769705470.0, 'created_time': 1768324172.027026, 'last_price_update_time': 1769620168.915484}
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EK01872') HTTP/1.1" 204 0
2026-01-28 17:09:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_19680b55ba863d43286159db79f36fd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5ce889-0331-5e61-bb47-4c048a143a43 with identifier: HT82047
2026-01-28 17:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5ce889-0331-5e61-bb47-4c048a143a43 with scrape type 2
2026-01-28 17:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5ce889-0331-5e61-bb47-4c048a143a43 with scrape type 2
2026-01-28 17:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7b5ce889-0331-5e61-bb47-4c048a143a43, identifier: HT82047
2026-01-28 17:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fafd1697-813d-5076-9d90-f2812120738d with identifier: VB61319
2026-01-28 17:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fafd1697-813d-5076-9d90-f2812120738d with scrape type 2
2026-01-28 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fafd1697-813d-5076-9d90-f2812120738d with scrape type 2
2026-01-28 17:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fafd1697-813d-5076-9d90-f2812120738d, identifier: VB61319
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62657850>
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg saved to cache
2026-01-28 17:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7b5ce889-0331-5e61-bb47-4c048a143a43 with identifier: HT82047
2026-01-28 17:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7b5ce889-0331-5e61-bb47-4c048a143a43 with identifier: HT82047
2026-01-28 17:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7b5ce889-0331-5e61-bb47-4c048a143a43 with identifier: HT82047 to the API
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HT82047>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2026-01-29T16:06:05Z',
 'fuel_type': 'petrol',
 'id': '7b5ce889-0331-5e61-bb47-4c048a143a43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT82047',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 56105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Go Plus',
 'transmission': 'manual',
 'trim': 'Go Plus',
 'year': 2018}
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HT82047%27 HTTP/1.1" 200 None
2026-01-28 17:09:30 [auto1.es] INFO: Saving data for HT82047: {'auction_closing_time': 1769702765.0, 'created_time': 1769003060.806688, 'last_price_update_time': 1769620170.181582}
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HT82047') HTTP/1.1" 204 0
2026-01-28 17:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fafd1697-813d-5076-9d90-f2812120738d with identifier: VB61319
2026-01-28 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fafd1697-813d-5076-9d90-f2812120738d with identifier: VB61319
2026-01-28 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
2026-01-28 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: fafd1697-813d-5076-9d90-f2812120738d spider: auto1.es
2026-01-28 17:09:30 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: fafd1697-813d-5076-9d90-f2812120738d due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'ranger' containing 'ranger'
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 212,
 'expiration_date': '2026-01-29T16:19:04Z',
 'fuel_type': 'diesel',
 'id': 'fafd1697-813d-5076-9d90-f2812120738d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB61319',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 125783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VB61319%27 HTTP/1.1" 200 None
2026-01-28 17:09:30 [auto1.es] INFO: Saving data for VB61319: {'auction_closing_time': 1769703544.0, 'created_time': 1764050545.762953, 'last_price_update_time': 1769620170.399593}
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VB61319') HTTP/1.1" 204 0
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63527210>
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F04%252F7604d776bdc5099e64bc65de7e84dc19%252Fpa%252FDJ93903_19680b55ba863d43286159db79f36fd1.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_19680b55ba863d43286159db79f36fd1.jpg saved to cache
2026-01-28 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0e868726-2826-5b65-88f6-a36623628a4b
2026-01-28 17:09:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0e868726-2826-5b65-88f6-a36623628a4b, skipping ID generation
2026-01-28 17:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e868726-2826-5b65-88f6-a36623628a4b with scrape type 1
2026-01-28 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0e868726-2826-5b65-88f6-a36623628a4b from tracking dictionaries
2026-01-28 17:09:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0e868726-2826-5b65-88f6-a36623628a4b sending to next pipeline
2026-01-28 17:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0e868726-2826-5b65-88f6-a36623628a4b, identifier: DJ93903
2026-01-28 17:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0e868726-2826-5b65-88f6-a36623628a4b with identifier: DJ93903
2026-01-28 17:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0e868726-2826-5b65-88f6-a36623628a4b with identifier: DJ93903
2026-01-28 17:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0e868726-2826-5b65-88f6-a36623628a4b with identifier: DJ93903 to the API
2026-01-28 17:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_19680b55ba863d43286159db79f36fd1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:57:59Z',
 'fuel_type': 'petrol',
 'id': '0e868726-2826-5b65-88f6-a36623628a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ93903',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 61910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245396,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_19680b55ba863d43286159db79f36fd1.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_28709748f600c8e95e6a088a7200a999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232568,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_8af1213bbbf049539ad18effd22bdbb0.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245396,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_efba762a4601394a099228aebe03dc30.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_de34e390c630a001622dcf80eb547291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_834f74eb2547c6aacbc8321954168566.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_fcd44d8e37582751f95fbdece259deea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_74bd1c404a71c8a909be10a6918f1cfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 164287,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_ea1074d8604925f864a28740676d0f0d.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_07df120f7d51c1e0d75b9e469ba4852d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154817,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_58bdbad060fb4ae6c2cdfbe9db615001.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0e868726-2826-5b65-88f6-a36623628a4b/0e868726-2826-5b65-88f6-a36623628a4b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/04/7604d776bdc5099e64bc65de7e84dc19/pa/DJ93903_7e2371269e206cee5c85df7f4736dc5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2024}
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DJ93903%27 HTTP/1.1" 200 None
2026-01-28 17:09:31 [auto1.es] INFO: Saving data for DJ93903: {'created_time': 1769620171.360779, 'last_price_update_time': 1769620171.36079, 'auction_closing_time': 1769705879.0}
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DJ93903') HTTP/1.1" 204 0
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG06255/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PT19275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF11696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV25666> (referer: https://www.auto1.com/v1/car-details-view/TV25666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TS46537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB20640> (referer: https://www.auto1.com/v1/car-details-view/SB20640/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB28672/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_a8e342195cd0bfe56cf9bba619119db1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with identifier: TV25666
2026-01-28 17:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with scrape type 2
2026-01-28 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with scrape type 2
2026-01-28 17:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc, identifier: TV25666
2026-01-28 17:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2d0c91a-fb52-5822-b3b1-0de769064cb5 with identifier: SB20640
2026-01-28 17:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2d0c91a-fb52-5822-b3b1-0de769064cb5 with scrape type 2
2026-01-28 17:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2d0c91a-fb52-5822-b3b1-0de769064cb5 with scrape type 2
2026-01-28 17:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2d0c91a-fb52-5822-b3b1-0de769064cb5, identifier: SB20640
2026-01-28 17:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with identifier: TV25666
2026-01-28 17:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with identifier: TV25666
2026-01-28 17:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc with identifier: TV25666 to the API
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV25666>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:26:13Z',
 'fuel_type': 'petrol',
 'id': '7a3cf77e-7d5a-5a6e-bb41-f4599253b8dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV25666',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': '500',
 'odometer': 109987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Dolcevita',
 'transmission': 'manual',
 'trim': 'Dolcevita',
 'year': 2022}
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TV25666%27 HTTP/1.1" 200 None
2026-01-28 17:09:31 [auto1.es] INFO: Saving data for TV25666: {'auction_closing_time': 1769703973.0, 'created_time': 1769002715.556193, 'last_price_update_time': 1769620171.96327}
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TV25666') HTTP/1.1" 204 0
2026-01-28 17:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2d0c91a-fb52-5822-b3b1-0de769064cb5 with identifier: SB20640
2026-01-28 17:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2d0c91a-fb52-5822-b3b1-0de769064cb5 with identifier: SB20640
2026-01-28 17:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f2d0c91a-fb52-5822-b3b1-0de769064cb5 with identifier: SB20640 to the API
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SB20640>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:22:46Z',
 'fuel_type': 'diesel',
 'id': 'f2d0c91a-fb52-5822-b3b1-0de769064cb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB20640',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 91756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Societé',
 'transmission': 'manual',
 'trim': 'Societé',
 'year': 2019}
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SB20640%27 HTTP/1.1" 200 None
2026-01-28 17:09:32 [auto1.es] INFO: Saving data for SB20640: {'auction_closing_time': 1769703766.0, 'created_time': 1769003009.939332, 'last_price_update_time': 1769620172.282605}
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SB20640') HTTP/1.1" 204 0
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634be650>
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_a8e342195cd0bfe56cf9bba619119db1.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_a8e342195cd0bfe56cf9bba619119db1.jpg saved to cache
2026-01-28 17:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU72387/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP66018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR78832> (referer: https://www.auto1.com/v1/car-details-view/GR78832/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KN26353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b492538a-e679-54b9-9d54-33c247ec30e7 with identifier: GR78832
2026-01-28 17:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b492538a-e679-54b9-9d54-33c247ec30e7 with scrape type 2
2026-01-28 17:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b492538a-e679-54b9-9d54-33c247ec30e7 with scrape type 2
2026-01-28 17:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b492538a-e679-54b9-9d54-33c247ec30e7, identifier: GR78832
2026-01-28 17:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b492538a-e679-54b9-9d54-33c247ec30e7 with identifier: GR78832
2026-01-28 17:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b492538a-e679-54b9-9d54-33c247ec30e7 with identifier: GR78832
2026-01-28 17:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
2026-01-28 17:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b492538a-e679-54b9-9d54-33c247ec30e7 spider: auto1.es
2026-01-28 17:09:33 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b492538a-e679-54b9-9d54-33c247ec30e7 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'rifter' containing 'rifter'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:16:46Z',
 'fuel_type': 'diesel',
 'id': 'b492538a-e679-54b9-9d54-33c247ec30e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR78832',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Rifter',
 'odometer': 175280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Rifter 1.5 Blue-HDi Active Pack L1',
 'transmission': 'manual',
 'trim': 'Active Pack L1',
 'year': 2022}
2026-01-28 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GR78832%27 HTTP/1.1" 200 None
2026-01-28 17:09:33 [auto1.es] INFO: Saving data for GR78832: {'auction_closing_time': 1769703406.0, 'created_time': 1769061658.485028, 'last_price_update_time': 1769620173.639794}
2026-01-28 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GR78832') HTTP/1.1" 204 0
2026-01-28 17:09:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA73273/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB78229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD09129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD98526> (referer: https://www.auto1.com/v1/car-details-view/ZD98526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d086ade2-cd10-5d57-87d4-c8d64aafa183 with identifier: ZD98526
2026-01-28 17:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d086ade2-cd10-5d57-87d4-c8d64aafa183 with scrape type 2
2026-01-28 17:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d086ade2-cd10-5d57-87d4-c8d64aafa183 with scrape type 2
2026-01-28 17:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d086ade2-cd10-5d57-87d4-c8d64aafa183, identifier: ZD98526
2026-01-28 17:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d086ade2-cd10-5d57-87d4-c8d64aafa183 with identifier: ZD98526
2026-01-28 17:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d086ade2-cd10-5d57-87d4-c8d64aafa183 with identifier: ZD98526
2026-01-28 17:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169950 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169950
2026-01-28 17:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d086ade2-cd10-5d57-87d4-c8d64aafa183 spider: auto1.es
2026-01-28 17:09:34 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: d086ade2-cd10-5d57-87d4-c8d64aafa183 due to rule: high_mileage_for_country.json, error: 169950 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169950
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:45:31Z',
 'fuel_type': 'petrol',
 'id': 'd086ade2-cd10-5d57-87d4-c8d64aafa183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD98526',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 169950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Like',
 'transmission': 'manual',
 'trim': 'Like',
 'year': 2018}
2026-01-28 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZD98526%27 HTTP/1.1" 200 None
2026-01-28 17:09:34 [auto1.es] INFO: Saving data for ZD98526: {'auction_closing_time': 1769705131.0, 'created_time': 1769003209.976299, 'last_price_update_time': 1769620174.965701}
2026-01-28 17:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZD98526') HTTP/1.1" 204 0
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN20473/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FV87750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ22507> (referer: https://www.auto1.com/v1/car-details-view/MJ22507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ66193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM12264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-01-28 17:09:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with scrape type 2
2026-01-28 17:09:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with scrape type 2
2026-01-28 17:09:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055, identifier: MJ22507
2026-01-28 17:09:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-01-28 17:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 with identifier: MJ22507
2026-01-28 17:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 192191 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192191
2026-01-28 17:09:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 spider: auto1.es
2026-01-28 17:09:35 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 44ea2c4b-d82b-5aeb-8b97-0c6a007a1055 due to rule: high_mileage_for_country.json, error: 192191 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    192191
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:37:25Z',
 'fuel_type': 'petrol',
 'id': '44ea2c4b-d82b-5aeb-8b97-0c6a007a1055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ22507',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 192191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MJ22507%27 HTTP/1.1" 200 None
2026-01-28 17:09:35 [auto1.es] INFO: Saving data for MJ22507: {'auction_closing_time': 1769704645.0, 'created_time': 1769061733.961105, 'last_price_update_time': 1769620175.600675}
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MJ22507') HTTP/1.1" 204 0
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV92592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_dda3f2354c2a7e46c99e643223800b72.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML61701/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a44890>
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_dda3f2354c2a7e46c99e643223800b72.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_dda3f2354c2a7e46c99e643223800b72.jpg saved to cache
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB28672> (referer: https://www.auto1.com/v1/car-details-view/UB28672/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7da31a-0d26-58a2-8da5-342be5ef1083 with identifier: UB28672
2026-01-28 17:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7da31a-0d26-58a2-8da5-342be5ef1083 with scrape type 1
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_59f8132687c5296eddbdfb7140f9aa06.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_07b88fb39161b1223ee3d19f46d995c4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_55faa897f936e3f710ff0747de1e83ff.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_93d6444c7f33e9617689e49249b52c87.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_c0b14c8ed51194b1f71966e75927258b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_58a6188b3c36b0370a2928bceecb106f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_b992fec31e3ef94227c610ae7318c34a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_a76fea29663987a07e33161fbf737241.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg not downloaded yet
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK15257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU72387> (referer: https://www.auto1.com/v1/car-details-view/YU72387/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbe42511-d439-5fdf-85d6-af3b58c90d2b with identifier: YU72387
2026-01-28 17:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe42511-d439-5fdf-85d6-af3b58c90d2b with scrape type 1
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg not downloaded yet
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP66018> (referer: https://www.auto1.com/v1/car-details-view/VP66018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_ee3ae21f7c49616a1e07f771414f363b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ee3ae21f7c49616a1e07f771414f363b.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_b62848aa913563c495ee548c402f3061.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b62848aa913563c495ee548c402f3061.jpg not downloaded yet
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg not downloaded yet
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_30366e7aed4115f1d863c7858fb5264f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_30366e7aed4115f1d863c7858fb5264f.jpg not downloaded yet
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TS46537> (referer: https://www.auto1.com/v1/car-details-view/TS46537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF11696> (referer: https://www.auto1.com/v1/car-details-view/BF11696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg not downloaded yet
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_6182f3a874d6feff20a4b5164aaadb24.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_6182f3a874d6feff20a4b5164aaadb24.jpg not downloaded yet
2026-01-28 17:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 271ac5bd-4e26-5535-af3e-ada764a77ab4 with identifier: VP66018
2026-01-28 17:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 271ac5bd-4e26-5535-af3e-ada764a77ab4 with scrape type 1
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 271ac5bd-4e26-5535-af3e-ada764a77ab4
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_50fd927792ff6a8e68baffaf3f593e6f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_50fd927792ff6a8e68baffaf3f593e6f.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_8bc611b19c46d6a64cade9907bd14009.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_8bc611b19c46d6a64cade9907bd14009.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_92a8662884ac4e0777c8e0c0c6638165.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_92a8662884ac4e0777c8e0c0c6638165.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_294c604c4251cf188fa22fa9b048e6ea.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_294c604c4251cf188fa22fa9b048e6ea.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_f203537df1a30001b6ba55c47e9cd4d2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_f203537df1a30001b6ba55c47e9cd4d2.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_ed1f0045006334883b3de66b30fec034.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_ed1f0045006334883b3de66b30fec034.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_e28a00ec78226b53631d692ce568e1d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_e28a00ec78226b53631d692ce568e1d8.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_2b3c2be12e8a699fe483931d565db419.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_2b3c2be12e8a699fe483931d565db419.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_7cab9e045af5177f609502713f3902f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7cab9e045af5177f609502713f3902f1.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_7bdf667c5cb3dc00295c8cf0be50f7a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7bdf667c5cb3dc00295c8cf0be50f7a2.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_d90f454c44c8e9ae2bfc9dc19158bc85.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d90f454c44c8e9ae2bfc9dc19158bc85.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_38af755c439f4d71a54bd3519714002d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_38af755c439f4d71a54bd3519714002d.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_d8140a7c002ef8fd21ede5cf3eb5b7d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d8140a7c002ef8fd21ede5cf3eb5b7d3.jpg already downloaded
2026-01-28 17:09:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_9b22ad6a2b8bd6deada86127a3e95832.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_9b22ad6a2b8bd6deada86127a3e95832.jpg already downloaded
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_281fe3bfd828c7a28bf67f774b048b72.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_281fe3bfd828c7a28bf67f774b048b72.jpg already downloaded
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F8e%252Fba8eeb04ce0261362d75ca2c985d0ba8%252Fpa%252FVP66018_5d371375c1fd079e2c10bb88f34240e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_5d371375c1fd079e2c10bb88f34240e3.jpg already downloaded
2026-01-28 17:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 271ac5bd-4e26-5535-af3e-ada764a77ab4, identifier: VP66018
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_3451e5a6cf920f65b5483746f467244d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3451e5a6cf920f65b5483746f467244d.jpg not downloaded yet
2026-01-28 17:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 271ac5bd-4e26-5535-af3e-ada764a77ab4 with identifier: VP66018
2026-01-28 17:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 271ac5bd-4e26-5535-af3e-ada764a77ab4 with identifier: VP66018
2026-01-28 17:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 271ac5bd-4e26-5535-af3e-ada764a77ab4 with identifier: VP66018 to the API
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VP66018>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:47:06Z',
 'fuel_type': 'petrol',
 'id': '271ac5bd-4e26-5535-af3e-ada764a77ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP66018',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 26772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_50fd927792ff6a8e68baffaf3f593e6f.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_8bc611b19c46d6a64cade9907bd14009.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_92a8662884ac4e0777c8e0c0c6638165.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_294c604c4251cf188fa22fa9b048e6ea.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_f203537df1a30001b6ba55c47e9cd4d2.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_ed1f0045006334883b3de66b30fec034.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_e28a00ec78226b53631d692ce568e1d8.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_2b3c2be12e8a699fe483931d565db419.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7cab9e045af5177f609502713f3902f1.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7bdf667c5cb3dc00295c8cf0be50f7a2.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d90f454c44c8e9ae2bfc9dc19158bc85.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_38af755c439f4d71a54bd3519714002d.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d8140a7c002ef8fd21ede5cf3eb5b7d3.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_9b22ad6a2b8bd6deada86127a3e95832.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_281fe3bfd828c7a28bf67f774b048b72.jpg',
                'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_5d371375c1fd079e2c10bb88f34240e3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_50fd927792ff6a8e68baffaf3f593e6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_8bc611b19c46d6a64cade9907bd14009.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_92a8662884ac4e0777c8e0c0c6638165.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_294c604c4251cf188fa22fa9b048e6ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65713,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_f203537df1a30001b6ba55c47e9cd4d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_ed1f0045006334883b3de66b30fec034.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_e28a00ec78226b53631d692ce568e1d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_2b3c2be12e8a699fe483931d565db419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7cab9e045af5177f609502713f3902f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_7bdf667c5cb3dc00295c8cf0be50f7a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d90f454c44c8e9ae2bfc9dc19158bc85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_38af755c439f4d71a54bd3519714002d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_d8140a7c002ef8fd21ede5cf3eb5b7d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_9b22ad6a2b8bd6deada86127a3e95832.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_281fe3bfd828c7a28bf67f774b048b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_271ac5bd-4e26-5535-af3e-ada764a77ab4/271ac5bd-4e26-5535-af3e-ada764a77ab4_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/8e/ba8eeb04ce0261362d75ca2c985d0ba8/pa/VP66018_5d371375c1fd079e2c10bb88f34240e3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VP66018%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [auto1.es] INFO: Saving data for VP66018: {'created_time': 1769620177.516843, 'last_price_update_time': 1769620177.516853, 'auction_closing_time': 1769705226.0}
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VP66018') HTTP/1.1" 204 0
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_31c6d83949526d4fc9f379d829367ff1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_31c6d83949526d4fc9f379d829367ff1.jpg not downloaded yet
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA73273> (referer: https://www.auto1.com/v1/car-details-view/WA73273/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB78229> (referer: https://www.auto1.com/v1/car-details-view/EB78229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_30366e7aed4115f1d863c7858fb5264f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KN26353> (referer: https://www.auto1.com/v1/car-details-view/KN26353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6296ec90>
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg saved to cache
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7af020c-1b63-51cf-be5c-f6c174c81190 with identifier: TS46537
2026-01-28 17:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7af020c-1b63-51cf-be5c-f6c174c81190 with scrape type 2
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7af020c-1b63-51cf-be5c-f6c174c81190 with scrape type 2
2026-01-28 17:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e7af020c-1b63-51cf-be5c-f6c174c81190, identifier: TS46537
2026-01-28 17:09:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9da44d3-7f44-5c04-970c-dba883964b71 with identifier: BF11696
2026-01-28 17:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9da44d3-7f44-5c04-970c-dba883964b71 with scrape type 2
2026-01-28 17:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9da44d3-7f44-5c04-970c-dba883964b71 with scrape type 2
2026-01-28 17:09:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b9da44d3-7f44-5c04-970c-dba883964b71, identifier: BF11696
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6340a650>
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg saved to cache
2026-01-28 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62892450>
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg saved to cache
2026-01-28 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b62848aa913563c495ee548c402f3061.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_26ce4109c20c82808835d5b06c332e20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_26ce4109c20c82808835d5b06c332e20.jpg not downloaded yet
2026-01-28 17:09:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e7af020c-1b63-51cf-be5c-f6c174c81190 with identifier: TS46537
2026-01-28 17:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e7af020c-1b63-51cf-be5c-f6c174c81190 with identifier: TS46537
2026-01-28 17:09:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e7af020c-1b63-51cf-be5c-f6c174c81190 with identifier: TS46537 to the API
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TS46537>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:42:58Z',
 'fuel_type': 'diesel',
 'id': 'e7af020c-1b63-51cf-be5c-f6c174c81190',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS46537',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 75272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2020}
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TS46537%27 HTTP/1.1" 200 None
2026-01-28 17:09:38 [auto1.es] INFO: Saving data for TS46537: {'auction_closing_time': 1769704978.0, 'created_time': 1768237425.704074, 'last_price_update_time': 1769620178.914771}
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TS46537') HTTP/1.1" 204 0
2026-01-28 17:09:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b9da44d3-7f44-5c04-970c-dba883964b71 with identifier: BF11696
2026-01-28 17:09:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b9da44d3-7f44-5c04-970c-dba883964b71 with identifier: BF11696
2026-01-28 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163133 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163133
2026-01-28 17:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b9da44d3-7f44-5c04-970c-dba883964b71 spider: auto1.es
2026-01-28 17:09:39 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b9da44d3-7f44-5c04-970c-dba883964b71 due to rule: high_mileage_for_country.json, error: 163133 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163133
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 235,
 'expiration_date': '2026-01-29T16:47:32Z',
 'fuel_type': 'diesel',
 'id': 'b9da44d3-7f44-5c04-970c-dba883964b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF11696',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 163133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2018}
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BF11696%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [auto1.es] INFO: Saving data for BF11696: {'auction_closing_time': 1769705252.0, 'created_time': 1768824448.325533, 'last_price_update_time': 1769620179.132306}
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BF11696') HTTP/1.1" 204 0
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg not downloaded yet
2026-01-28 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PT19275> (referer: https://www.auto1.com/v1/car-details-view/PT19275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD09129> (referer: https://www.auto1.com/v1/car-details-view/LD09129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625d2890>
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg saved to cache
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe with identifier: WA73273
2026-01-28 17:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe with scrape type 1
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_7839fb07bca5541b91ede78f87a598a9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7839fb07bca5541b91ede78f87a598a9.jpg not downloaded yet
2026-01-28 17:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62353759-db36-5c0f-bd5a-faaa64a980c8 with identifier: EB78229
2026-01-28 17:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62353759-db36-5c0f-bd5a-faaa64a980c8 with scrape type 2
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62353759-db36-5c0f-bd5a-faaa64a980c8 with scrape type 2
2026-01-28 17:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 62353759-db36-5c0f-bd5a-faaa64a980c8, identifier: EB78229
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635fa510>
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_30366e7aed4115f1d863c7858fb5264f.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_30366e7aed4115f1d863c7858fb5264f.jpg saved to cache
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5 with identifier: KN26353
2026-01-28 17:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5 with scrape type 1
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_2979af2f4d7333b864abee4a2a438544.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2979af2f4d7333b864abee4a2a438544.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_e390fb5bdf6110fba6d60530a677b854.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e390fb5bdf6110fba6d60530a677b854.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_dbf9cb6d23b3619d60f19140aca7ea90.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_dbf9cb6d23b3619d60f19140aca7ea90.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_d8a16e54477b499aac01cd31381c39de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_d8a16e54477b499aac01cd31381c39de.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_2d3f0d58c017c6d97ad1808bf9129ea7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2d3f0d58c017c6d97ad1808bf9129ea7.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_fc30031e7d34b4ca0a265a06b254817a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_fc30031e7d34b4ca0a265a06b254817a.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_53afbfcc54fb2f0865c51ee9edb0adf1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_53afbfcc54fb2f0865c51ee9edb0adf1.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_531e977558bd2e9212dafbe6ec12db06.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_531e977558bd2e9212dafbe6ec12db06.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_e70987fe06325e254773645045212453.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e70987fe06325e254773645045212453.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_99091d86e87283364bbf2b14ab5c160b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_99091d86e87283364bbf2b14ab5c160b.jpg already downloaded
2026-01-28 17:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_4c8dc93391096308263b0e4c3fe8692f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4c8dc93391096308263b0e4c3fe8692f.jpg already downloaded
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_1444b551de6ef21f7824f4143cb1ea39.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_1444b551de6ef21f7824f4143cb1ea39.jpg already downloaded
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_804483e22bdd8269fe4d065c8efe0a0a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_804483e22bdd8269fe4d065c8efe0a0a.jpg already downloaded
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_17b2f1227ebcb9c926b2b2cfe2b5e6bd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_17b2f1227ebcb9c926b2b2cfe2b5e6bd.jpg already downloaded
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_af4d387912daddbab2144b2caacc74a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_af4d387912daddbab2144b2caacc74a0.jpg already downloaded
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F21%252F6b21ad682febefb1e5cd0c1235df9512%252Fpa%252FKN26353_4be1f6abf13e4748d660fc41946c6889.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4be1f6abf13e4748d660fc41946c6889.jpg already downloaded
2026-01-28 17:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5, identifier: KN26353
2026-01-28 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3451e5a6cf920f65b5483746f467244d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 62353759-db36-5c0f-bd5a-faaa64a980c8 with identifier: EB78229
2026-01-28 17:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 62353759-db36-5c0f-bd5a-faaa64a980c8 with identifier: EB78229
2026-01-28 17:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 145992 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145992
2026-01-28 17:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 62353759-db36-5c0f-bd5a-faaa64a980c8 spider: auto1.es
2026-01-28 17:09:40 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 62353759-db36-5c0f-bd5a-faaa64a980c8 due to rule: high_mileage_for_make.json, error: 145992 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    145992
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:48:03Z',
 'fuel_type': 'gas',
 'id': '62353759-db36-5c0f-bd5a-faaa64a980c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB78229',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 145992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe LPG Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2022}
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EB78229%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [auto1.es] INFO: Saving data for EB78229: {'auction_closing_time': 1769705283.0, 'created_time': 1764050483.358028, 'last_price_update_time': 1769620180.42369}
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EB78229') HTTP/1.1" 204 0
2026-01-28 17:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5 with identifier: KN26353
2026-01-28 17:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5 with identifier: KN26353
2026-01-28 17:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5 with identifier: KN26353 to the API
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KN26353>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 129,
 'expiration_date': '2026-01-29T16:02:02Z',
 'fuel_type': 'petrol',
 'id': '19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN26353',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 63702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2979af2f4d7333b864abee4a2a438544.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e390fb5bdf6110fba6d60530a677b854.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_dbf9cb6d23b3619d60f19140aca7ea90.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_d8a16e54477b499aac01cd31381c39de.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2d3f0d58c017c6d97ad1808bf9129ea7.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_fc30031e7d34b4ca0a265a06b254817a.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_53afbfcc54fb2f0865c51ee9edb0adf1.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_531e977558bd2e9212dafbe6ec12db06.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e70987fe06325e254773645045212453.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_99091d86e87283364bbf2b14ab5c160b.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4c8dc93391096308263b0e4c3fe8692f.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_1444b551de6ef21f7824f4143cb1ea39.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_804483e22bdd8269fe4d065c8efe0a0a.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_17b2f1227ebcb9c926b2b2cfe2b5e6bd.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_af4d387912daddbab2144b2caacc74a0.jpg',
                'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4be1f6abf13e4748d660fc41946c6889.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2979af2f4d7333b864abee4a2a438544.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e390fb5bdf6110fba6d60530a677b854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_dbf9cb6d23b3619d60f19140aca7ea90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_d8a16e54477b499aac01cd31381c39de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_2d3f0d58c017c6d97ad1808bf9129ea7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_fc30031e7d34b4ca0a265a06b254817a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_53afbfcc54fb2f0865c51ee9edb0adf1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_531e977558bd2e9212dafbe6ec12db06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_e70987fe06325e254773645045212453.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_99091d86e87283364bbf2b14ab5c160b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4c8dc93391096308263b0e4c3fe8692f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_1444b551de6ef21f7824f4143cb1ea39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_804483e22bdd8269fe4d065c8efe0a0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_17b2f1227ebcb9c926b2b2cfe2b5e6bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_af4d387912daddbab2144b2caacc74a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5/19a39d8a-13f2-54e2-9a2c-0a4d2ebbcdc5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/21/6b21ad682febefb1e5cd0c1235df9512/pa/KN26353_4be1f6abf13e4748d660fc41946c6889.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T2 R Design 2WD',
 'transmission': 'automatic',
 'trim': 'R Design 2WD',
 'year': 2020}
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KN26353%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [auto1.es] INFO: Saving data for KN26353: {'created_time': 1769620180.742955, 'last_price_update_time': 1769620180.742965, 'auction_closing_time': 1769702522.0}
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KN26353') HTTP/1.1" 204 0
2026-01-28 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_31c6d83949526d4fc9f379d829367ff1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg not downloaded yet
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg not downloaded yet
2026-01-28 17:09:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636c3750>
2026-01-28 17:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_b62848aa913563c495ee548c402f3061.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b62848aa913563c495ee548c402f3061.jpg saved to cache
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_6182f3a874d6feff20a4b5164aaadb24.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ee3ae21f7c49616a1e07f771414f363b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FV87750> (referer: https://www.auto1.com/v1/car-details-view/FV87750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN20473> (referer: https://www.auto1.com/v1/car-details-view/CN20473/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG06255> (referer: https://www.auto1.com/v1/car-details-view/UG06255/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg not downloaded yet
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_82634c016b84f498298a030720a5d529.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_82634c016b84f498298a030720a5d529.jpg not downloaded yet
2026-01-28 17:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043cdd8f-8d85-5048-833a-1e6f52bdd939 with identifier: PT19275
2026-01-28 17:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043cdd8f-8d85-5048-833a-1e6f52bdd939 with scrape type 2
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043cdd8f-8d85-5048-833a-1e6f52bdd939 with scrape type 2
2026-01-28 17:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 043cdd8f-8d85-5048-833a-1e6f52bdd939, identifier: PT19275
2026-01-28 17:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28f22313-1b12-5c1d-b398-2618d004deca with identifier: LD09129
2026-01-28 17:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28f22313-1b12-5c1d-b398-2618d004deca with scrape type 2
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28f22313-1b12-5c1d-b398-2618d004deca with scrape type 2
2026-01-28 17:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 28f22313-1b12-5c1d-b398-2618d004deca, identifier: LD09129
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636bc910>
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_3451e5a6cf920f65b5483746f467244d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3451e5a6cf920f65b5483746f467244d.jpg saved to cache
2026-01-28 17:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 043cdd8f-8d85-5048-833a-1e6f52bdd939 with identifier: PT19275
2026-01-28 17:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 043cdd8f-8d85-5048-833a-1e6f52bdd939 with identifier: PT19275
2026-01-28 17:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 043cdd8f-8d85-5048-833a-1e6f52bdd939 with identifier: PT19275 to the API
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PT19275>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:48:55Z',
 'fuel_type': 'petrol',
 'id': '043cdd8f-8d85-5048-833a-1e6f52bdd939',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT19275',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 51472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2023}
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PT19275%27 HTTP/1.1" 200 None
2026-01-28 17:09:41 [auto1.es] INFO: Saving data for PT19275: {'auction_closing_time': 1769705335.0, 'created_time': 1768298534.372814, 'last_price_update_time': 1769620181.963966}
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PT19275') HTTP/1.1" 204 0
2026-01-28 17:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 28f22313-1b12-5c1d-b398-2618d004deca with identifier: LD09129
2026-01-28 17:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 28f22313-1b12-5c1d-b398-2618d004deca with identifier: LD09129
2026-01-28 17:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 28f22313-1b12-5c1d-b398-2618d004deca with identifier: LD09129 to the API
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LD09129>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:42:41Z',
 'fuel_type': 'diesel',
 'id': '28f22313-1b12-5c1d-b398-2618d004deca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD09129',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 148392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.6 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2018}
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LD09129%27 HTTP/1.1" 200 None
2026-01-28 17:09:42 [auto1.es] INFO: Saving data for LD09129: {'auction_closing_time': 1769704961.0, 'created_time': 1769003024.116495, 'last_price_update_time': 1769620182.286522}
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LD09129') HTTP/1.1" 204 0
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62324150>
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg saved to cache
2026-01-28 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635da690>
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg saved to cache
2026-01-28 17:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62653e90>
2026-01-28 17:09:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_31c6d83949526d4fc9f379d829367ff1.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_31c6d83949526d4fc9f379d829367ff1.jpg saved to cache
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg not downloaded yet
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7839fb07bca5541b91ede78f87a598a9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML61701> (referer: https://www.auto1.com/v1/car-details-view/ML61701/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62457d10>
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_6182f3a874d6feff20a4b5164aaadb24.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_6182f3a874d6feff20a4b5164aaadb24.jpg saved to cache
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e8310>
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_ee3ae21f7c49616a1e07f771414f363b.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ee3ae21f7c49616a1e07f771414f363b.jpg saved to cache
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f with identifier: FV87750
2026-01-28 17:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f, identifier: FV87750
2026-01-28 17:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cb49a1-9566-5fd6-bf5e-7445004b2343 with identifier: CN20473
2026-01-28 17:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cb49a1-9566-5fd6-bf5e-7445004b2343 with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34cb49a1-9566-5fd6-bf5e-7445004b2343 with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 34cb49a1-9566-5fd6-bf5e-7445004b2343, identifier: CN20473
2026-01-28 17:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48bbecaa-fd3c-57a7-84cf-57cf98335594 with identifier: UG06255
2026-01-28 17:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bbecaa-fd3c-57a7-84cf-57cf98335594 with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48bbecaa-fd3c-57a7-84cf-57cf98335594 with scrape type 2
2026-01-28 17:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 48bbecaa-fd3c-57a7-84cf-57cf98335594, identifier: UG06255
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_26ce4109c20c82808835d5b06c332e20.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg not downloaded yet
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ66193> (referer: https://www.auto1.com/v1/car-details-view/RJ66193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM12264> (referer: https://www.auto1.com/v1/car-details-view/EM12264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f with identifier: FV87750
2026-01-28 17:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f with identifier: FV87750
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 193769 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193769
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f spider: auto1.es
2026-01-28 17:09:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f due to rule: high_mileage_for_country.json, error: 193769 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    193769
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:35:06Z',
 'fuel_type': 'diesel',
 'id': '72b585eb-43ef-5dc4-b5e1-13c0f0d16d4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV87750',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 193769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FV87750%27 HTTP/1.1" 200 None
2026-01-28 17:09:44 [auto1.es] INFO: Saving data for FV87750: {'auction_closing_time': 1769704506.0, 'created_time': 1769061722.143491, 'last_price_update_time': 1769620184.132787}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FV87750') HTTP/1.1" 204 0
2026-01-28 17:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 34cb49a1-9566-5fd6-bf5e-7445004b2343 with identifier: CN20473
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 34cb49a1-9566-5fd6-bf5e-7445004b2343 with identifier: CN20473
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184854 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184854
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 34cb49a1-9566-5fd6-bf5e-7445004b2343 spider: auto1.es
2026-01-28 17:09:44 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 34cb49a1-9566-5fd6-bf5e-7445004b2343 due to rule: high_mileage_for_country.json, error: 184854 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184854
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:03:46Z',
 'fuel_type': 'diesel',
 'id': '34cb49a1-9566-5fd6-bf5e-7445004b2343',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN20473',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 184854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Td4 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2017}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CN20473%27 HTTP/1.1" 200 None
2026-01-28 17:09:44 [auto1.es] INFO: Saving data for CN20473: {'auction_closing_time': 1769702626.0, 'created_time': 1769061843.470543, 'last_price_update_time': 1769620184.362523}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CN20473') HTTP/1.1" 204 0
2026-01-28 17:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 48bbecaa-fd3c-57a7-84cf-57cf98335594 with identifier: UG06255
2026-01-28 17:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 48bbecaa-fd3c-57a7-84cf-57cf98335594 with identifier: UG06255
2026-01-28 17:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 48bbecaa-fd3c-57a7-84cf-57cf98335594 with identifier: UG06255 to the API
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG06255>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 91,
 'expiration_date': '2026-01-29T16:10:50Z',
 'fuel_type': 'petrol',
 'id': '48bbecaa-fd3c-57a7-84cf-57cf98335594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG06255',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 44740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2022}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG06255%27 HTTP/1.1" 200 None
2026-01-28 17:09:44 [auto1.es] INFO: Saving data for UG06255: {'auction_closing_time': 1769703050.0, 'created_time': 1769187966.403224, 'last_price_update_time': 1769620184.658274}
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG06255') HTTP/1.1" 204 0
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8dc10>
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg saved to cache
2026-01-28 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg not downloaded yet
2026-01-28 17:09:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK15257> (referer: https://www.auto1.com/v1/car-details-view/AK15257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6262ed50>
2026-01-28 17:09:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_a76fea29663987a07e33161fbf737241.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg saved to cache
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628b6810>
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_7839fb07bca5541b91ede78f87a598a9.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7839fb07bca5541b91ede78f87a598a9.jpg saved to cache
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62570d90>
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg saved to cache
2026-01-28 17:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a48450>
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_b992fec31e3ef94227c610ae7318c34a.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg saved to cache
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3049c0fc-1b71-5a49-b607-9ee937876277 with identifier: ML61701
2026-01-28 17:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3049c0fc-1b71-5a49-b607-9ee937876277 with scrape type 2
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3049c0fc-1b71-5a49-b607-9ee937876277 with scrape type 2
2026-01-28 17:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3049c0fc-1b71-5a49-b607-9ee937876277, identifier: ML61701
2026-01-28 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3049c0fc-1b71-5a49-b607-9ee937876277 with identifier: ML61701
2026-01-28 17:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3049c0fc-1b71-5a49-b607-9ee937876277 with identifier: ML61701
2026-01-28 17:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 180965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180965
2026-01-28 17:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3049c0fc-1b71-5a49-b607-9ee937876277 spider: auto1.es
2026-01-28 17:09:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3049c0fc-1b71-5a49-b607-9ee937876277 due to rule: high_mileage_for_country.json, error: 180965 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    180965
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 197,
 'expiration_date': '2026-01-29T16:19:56Z',
 'fuel_type': 'diesel',
 'id': '3049c0fc-1b71-5a49-b607-9ee937876277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML61701',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 180965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2022}
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML61701%27 HTTP/1.1" 200 None
2026-01-28 17:09:46 [auto1.es] INFO: Saving data for ML61701: {'auction_closing_time': 1769703596.0, 'created_time': 1769061723.539605, 'last_price_update_time': 1769620186.314313}
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML61701') HTTP/1.1" 204 0
2026-01-28 17:09:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_82634c016b84f498298a030720a5d529.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg not downloaded yet
2026-01-28 17:09:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6351c150>
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_26ce4109c20c82808835d5b06c332e20.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_26ce4109c20c82808835d5b06c332e20.jpg saved to cache
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a94250>
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_c0b14c8ed51194b1f71966e75927258b.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg saved to cache
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b763b39-8de6-531c-b5d5-c430a3af6f8b with identifier: RJ66193
2026-01-28 17:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b763b39-8de6-531c-b5d5-c430a3af6f8b with scrape type 2
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b763b39-8de6-531c-b5d5-c430a3af6f8b with scrape type 2
2026-01-28 17:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b763b39-8de6-531c-b5d5-c430a3af6f8b, identifier: RJ66193
2026-01-28 17:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2026-01-28 17:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9555488-21ad-5f6b-859f-107133df2833 with scrape type 2
2026-01-28 17:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9555488-21ad-5f6b-859f-107133df2833 with scrape type 2
2026-01-28 17:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9555488-21ad-5f6b-859f-107133df2833, identifier: EM12264
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f1410>
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_58a6188b3c36b0370a2928bceecb106f.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg saved to cache
2026-01-28 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b763b39-8de6-531c-b5d5-c430a3af6f8b with identifier: RJ66193
2026-01-28 17:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b763b39-8de6-531c-b5d5-c430a3af6f8b with identifier: RJ66193
2026-01-28 17:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b763b39-8de6-531c-b5d5-c430a3af6f8b with identifier: RJ66193 to the API
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RJ66193>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-01-29T16:00:34Z',
 'fuel_type': 'petrol',
 'id': '4b763b39-8de6-531c-b5d5-c430a3af6f8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ66193',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Hyundai',
 'model': 'Bayon',
 'odometer': 16423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Bayon 1.0 T-GDI Mild-Hybrid Tecno 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno 2WD',
 'year': 2023}
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RJ66193%27 HTTP/1.1" 200 None
2026-01-28 17:09:47 [auto1.es] INFO: Saving data for RJ66193: {'auction_closing_time': 1769702434.0, 'created_time': 1769003491.968169, 'last_price_update_time': 1769620187.560303}
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RJ66193') HTTP/1.1" 204 0
2026-01-28 17:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2026-01-28 17:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264
2026-01-28 17:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: f9555488-21ad-5f6b-859f-107133df2833 with identifier: EM12264 to the API
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EM12264>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:08:24Z',
 'fuel_type': 'diesel',
 'id': 'f9555488-21ad-5f6b-859f-107133df2833',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM12264',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 35256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2022}
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM12264%27 HTTP/1.1" 200 None
2026-01-28 17:09:47 [auto1.es] INFO: Saving data for EM12264: {'auction_closing_time': 1769702904.0, 'created_time': 1768237355.368316, 'last_price_update_time': 1769620187.865549}
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM12264') HTTP/1.1" 204 0
2026-01-28 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_1aff4debc9adcae1107f9cf0599e2684.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1aff4debc9adcae1107f9cf0599e2684.jpg not downloaded yet
2026-01-28 17:09:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625e2e50>
2026-01-28 17:09:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_55faa897f936e3f710ff0747de1e83ff.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg saved to cache
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624d1390>
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg saved to cache
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624d3b90>
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_93d6444c7f33e9617689e49249b52c87.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg saved to cache
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 976e7815-8125-50af-b939-9eb370bb9693 with identifier: AK15257
2026-01-28 17:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 976e7815-8125-50af-b939-9eb370bb9693 with scrape type 1
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_e31186ec565930eb66fc742ff80e40ce.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg not downloaded yet
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6269b410>
2026-01-28 17:09:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg saved to cache
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634de210>
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F40%252F5140b813ffabedcb62c720e9f714ff95%252Fpa%252FYU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg saved to cache
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item dbe42511-d439-5fdf-85d6-af3b58c90d2b
2026-01-28 17:09:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbe42511-d439-5fdf-85d6-af3b58c90d2b, skipping ID generation
2026-01-28 17:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbe42511-d439-5fdf-85d6-af3b58c90d2b with scrape type 1
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dbe42511-d439-5fdf-85d6-af3b58c90d2b from tracking dictionaries
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbe42511-d439-5fdf-85d6-af3b58c90d2b sending to next pipeline
2026-01-28 17:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dbe42511-d439-5fdf-85d6-af3b58c90d2b, identifier: YU72387
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63471290>
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_82634c016b84f498298a030720a5d529.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_82634c016b84f498298a030720a5d529.jpg saved to cache
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg not downloaded yet
2026-01-28 17:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dbe42511-d439-5fdf-85d6-af3b58c90d2b with identifier: YU72387
2026-01-28 17:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dbe42511-d439-5fdf-85d6-af3b58c90d2b with identifier: YU72387
2026-01-28 17:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: dbe42511-d439-5fdf-85d6-af3b58c90d2b with identifier: YU72387 to the API
2026-01-28 17:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:36:44Z',
 'fuel_type': 'petrol',
 'id': 'dbe42511-d439-5fdf-85d6-af3b58c90d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72387',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 78102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b319c73f32e4a998c7a1d23b26e8a1f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ee3ae21f7c49616a1e07f771414f363b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220100,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_b62848aa913563c495ee548c402f3061.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_ccb78e6978f89181f3cb03b4b39517cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 175955,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_30366e7aed4115f1d863c7858fb5264f.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 235029,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_41f4d2c2abd21f80ed47f330c11cc101.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 268233,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_6182f3a874d6feff20a4b5164aaadb24.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3451e5a6cf920f65b5483746f467244d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_31c6d83949526d4fc9f379d829367ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 176148,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_26ce4109c20c82808835d5b06c332e20.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_3dff0d5abb02033bae49f2e91a3cb63a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117503,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_e8e46791116ae70cf0f9559ed6e5107a.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbe42511-d439-5fdf-85d6-af3b58c90d2b/dbe42511-d439-5fdf-85d6-af3b58c90d2b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/40/5140b813ffabedcb62c720e9f714ff95/pa/YU72387_27ab4c395f7df2b19323a76a3dc86a20.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2023}
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU72387%27 HTTP/1.1" 200 None
2026-01-28 17:09:50 [auto1.es] INFO: Saving data for YU72387: {'created_time': 1769620190.244411, 'last_price_update_time': 1769620190.244422, 'auction_closing_time': 1769704604.0}
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU72387') HTTP/1.1" 204 0
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_3a072101caad2ee5d565389080c1f100.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg not downloaded yet
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2ed463c70da50efc1389969c464013eb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg not downloaded yet
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MH75346> (referer: https://www.auto1.com/v1/car-details-view/MH75346/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV92592> (referer: https://www.auto1.com/v1/car-details-view/AV92592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL81396/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS89445> (referer: https://www.auto1.com/v1/car-details-view/HS89445/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634cf4d0>
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_59f8132687c5296eddbdfb7140f9aa06.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg saved to cache
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634cdd10>
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg saved to cache
2026-01-28 17:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62553b50>
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg saved to cache
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_9ddd751570ea20b028cccd78a8699f00.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg not downloaded yet
2026-01-28 17:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6363ae10>
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc3%252F01c39712c2f422a684b23958da50b4de%252Fpa%252FUB28672_07b88fb39161b1223ee3d19f46d995c4.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg saved to cache
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f7da31a-0d26-58a2-8da5-342be5ef1083
2026-01-28 17:09:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f7da31a-0d26-58a2-8da5-342be5ef1083, skipping ID generation
2026-01-28 17:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7da31a-0d26-58a2-8da5-342be5ef1083 with scrape type 1
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f7da31a-0d26-58a2-8da5-342be5ef1083 from tracking dictionaries
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f7da31a-0d26-58a2-8da5-342be5ef1083 sending to next pipeline
2026-01-28 17:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7f7da31a-0d26-58a2-8da5-342be5ef1083, identifier: UB28672
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63477390>
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg saved to cache
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg not downloaded yet
2026-01-28 17:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7f7da31a-0d26-58a2-8da5-342be5ef1083 with identifier: UB28672
2026-01-28 17:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7f7da31a-0d26-58a2-8da5-342be5ef1083 with identifier: UB28672
2026-01-28 17:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 40906, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub28672', 'expiration_date': '2026-01-29t16:40:20z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 2, 'c_o_2_emission_value': None, 'id': '7f7da31a-0d26-58a2-8da5-342be5ef1083', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 322228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 117138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 205060}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56314}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 228213}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40074}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73734}], 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 40906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:40:20z',
     'fuel_type': 'electro',
     'id': '7f7da31a-0d26-58a2-8da5-342be5ef1083',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub28672',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 40906,
     'odometer_in_km': 40906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95121,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 322228,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60799,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60799,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 117138,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77435,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205060,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 97514,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56314,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 228213,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40074,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39134,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73734,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-22',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
2026-01-28 17:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 7f7da31a-0d26-58a2-8da5-342be5ef1083 spider: auto1.es
2026-01-28 17:09:51 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7f7da31a-0d26-58a2-8da5-342be5ef1083 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 13, 'seller_name': None, 'price_includes_vat': True, 'title': 'maxus deliver 3 electric drive 90 kw l1h1', 'price': 0, 'currency': 'eur', 'make': 'maxus', 'model': 'deliver 3', 'transmission': 'automatic', 'odometer': 40906, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-22', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub28672', 'expiration_date': '2026-01-29t16:40:20z', 'origin_country_code': 'es', 'trim': 'l1h1', 'year': 2022, 'fuel_type': 'electro', 'listing': 'auction', 'engine_horse_power': 122, 'doors_number': 4, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '', 'location': 'es', 'category': None, 'seats_number': 2, 'c_o_2_emission_value': None, 'id': '7f7da31a-0d26-58a2-8da5-342be5ef1083', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 322228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 60799}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 117138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77435}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 205060}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 97514}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56314}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 228213}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 40074}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 39134}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73734}], 'current_year_diff': 4, 'age_in_months': 38, 'make_model': 'maxus deliver 3', 'sanitized_make': 'maxus', 'odometer_in_km': 40906}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'white',
     'currency': 'eur',
     'current_year_diff': 4,
     'doors_number': 4,
     'engine': '',
     'engine_horse_power': 122,
     'expiration_date': '2026-01-29t16:40:20z',
     'fuel_type': 'electro',
     'id': '7f7da31a-0d26-58a2-8da5-342be5ef1083',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ub28672',
     'listing': 'auction',
     'location': 'es',
     'make': 'maxus',
     'make_model': 'maxus deliver 3',
     'model': 'deliver 3',
     'odometer': 40906,
     'odometer_in_km': 40906,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 13,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95121,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 322228,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60799,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 60799,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 117138,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77435,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 205060,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 97514,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56314,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 228213,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40074,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 39134,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73734,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2022-11-22',
     'sanitized_make': 'maxus',
     'seats_number': 2,
     'seller_name': None,
     'title': 'maxus deliver 3 electric drive 90 kw l1h1',
     'transmission': 'automatic',
     'trim': 'l1h1',
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:40:20Z',
 'fuel_type': 'electro',
 'id': '7f7da31a-0d26-58a2-8da5-342be5ef1083',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB28672',
 'listing': 'auction',
 'location': 'ES',
 'make': 'MAXUS',
 'model': 'Deliver 3',
 'odometer': 40906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 13,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_59f8132687c5296eddbdfb7140f9aa06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322228,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_07b88fb39161b1223ee3d19f46d995c4.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_33bd61ea268fdf6c903b1fe69326db2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_55faa897f936e3f710ff0747de1e83ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117138,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_93d6444c7f33e9617689e49249b52c87.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_c0b14c8ed51194b1f71966e75927258b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 205060,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_58a6188b3c36b0370a2928bceecb106f.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_b992fec31e3ef94227c610ae7318c34a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_a76fea29663987a07e33161fbf737241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 228213,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_fc46c106f1b4a698c1fc9491f9cea948.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_aa23ac55a841034e41a4a3ee9cbeb2b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_85c9e4ee21c3dc47a29df0fc833453b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f7da31a-0d26-58a2-8da5-342be5ef1083/7f7da31a-0d26-58a2-8da5-342be5ef1083_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c3/01c39712c2f422a684b23958da50b4de/pa/UB28672_7f1210e4f8f98649e9e7fd3c3501a7bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-22',
 'seats_number': 2,
 'seller_name': None,
 'title': 'MAXUS Deliver 3 electric drive 90 kW L1H1',
 'transmission': 'automatic',
 'trim': 'L1H1',
 'year': 2022}
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UB28672%27 HTTP/1.1" 200 None
2026-01-28 17:09:51 [auto1.es] INFO: Saving data for UB28672: {'created_time': 1769620191.891104, 'last_price_update_time': 1769620191.891115, 'auction_closing_time': 1769704820.0}
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UB28672') HTTP/1.1" 204 0
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1aff4debc9adcae1107f9cf0599e2684.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg not downloaded yet
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA44200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AX39994> (referer: https://www.auto1.com/v1/car-details-view/AX39994/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP24592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624ac890>
2026-01-28 17:09:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg saved to cache
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63652c10>
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_2ed463c70da50efc1389969c464013eb.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2ed463c70da50efc1389969c464013eb.jpg saved to cache
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63650390>
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg saved to cache
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db5e0bea-8e70-592c-b733-7873a07d9bf0 with identifier: MH75346
2026-01-28 17:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5e0bea-8e70-592c-b733-7873a07d9bf0 with scrape type 1
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg not downloaded yet
2026-01-28 17:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0d14ea-9990-5180-adb3-f71e97075151 with identifier: AV92592
2026-01-28 17:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0d14ea-9990-5180-adb3-f71e97075151 with scrape type 2
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0d14ea-9990-5180-adb3-f71e97075151 with scrape type 2
2026-01-28 17:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3c0d14ea-9990-5180-adb3-f71e97075151, identifier: AV92592
2026-01-28 17:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b124ca-9040-5105-a841-583390c22be9 with identifier: HS89445
2026-01-28 17:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b124ca-9040-5105-a841-583390c22be9 with scrape type 2
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b124ca-9040-5105-a841-583390c22be9 with scrape type 2
2026-01-28 17:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 44b124ca-9040-5105-a841-583390c22be9, identifier: HS89445
2026-01-28 17:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_9f48e93a67cf3a25714cc03b031f6710.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9f48e93a67cf3a25714cc03b031f6710.jpg not downloaded yet
2026-01-28 17:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3c0d14ea-9990-5180-adb3-f71e97075151 with identifier: AV92592
2026-01-28 17:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3c0d14ea-9990-5180-adb3-f71e97075151 with identifier: AV92592
2026-01-28 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 198596 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198596
2026-01-28 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 3c0d14ea-9990-5180-adb3-f71e97075151 spider: auto1.es
2026-01-28 17:09:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 3c0d14ea-9990-5180-adb3-f71e97075151 due to rule: high_mileage_for_country.json, error: 198596 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    198596
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:21:24Z',
 'fuel_type': 'diesel',
 'id': '3c0d14ea-9990-5180-adb3-f71e97075151',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV92592',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 198596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style Go',
 'transmission': 'manual',
 'trim': 'Style Go',
 'year': 2021}
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AV92592%27 HTTP/1.1" 200 None
2026-01-28 17:09:53 [auto1.es] INFO: Saving data for AV92592: {'auction_closing_time': 1769703684.0, 'created_time': 1769101404.255363, 'last_price_update_time': 1769620193.162574}
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AV92592') HTTP/1.1" 204 0
2026-01-28 17:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 44b124ca-9040-5105-a841-583390c22be9 with identifier: HS89445
2026-01-28 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 44b124ca-9040-5105-a841-583390c22be9 with identifier: HS89445
2026-01-28 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171097
2026-01-28 17:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 44b124ca-9040-5105-a841-583390c22be9 spider: auto1.es
2026-01-28 17:09:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 44b124ca-9040-5105-a841-583390c22be9 due to rule: high_mileage_for_country.json, error: 171097 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171097
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:37:00Z',
 'fuel_type': 'diesel',
 'id': '44b124ca-9040-5105-a841-583390c22be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS89445',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 171097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kadjar 1.5 BLUE dCi Zen',
 'transmission': 'manual',
 'trim': 'Zen',
 'year': 2020}
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HS89445%27 HTTP/1.1" 200 None
2026-01-28 17:09:53 [auto1.es] INFO: Saving data for HS89445: {'auction_closing_time': 1769704620.0, 'created_time': 1769061660.688661, 'last_price_update_time': 1769620193.379755}
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HS89445') HTTP/1.1" 204 0
2026-01-28 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg not downloaded yet
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_7424684d79aab86c54ee87a8ee8435b2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_7424684d79aab86c54ee87a8ee8435b2.jpg not downloaded yet
2026-01-28 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_ba948b7b36711c1a442ad26c687db4bd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_32df5ea16203866ed04759abc33b73cb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg not downloaded yet
2026-01-28 17:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a52890>
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F9e%252F8d9e9ddef1feb21c4b151a772c37e195%252Fpa%252FYK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg saved to cache
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fbc99341-966a-591b-abb1-eb2d0498aa24
2026-01-28 17:09:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fbc99341-966a-591b-abb1-eb2d0498aa24, skipping ID generation
2026-01-28 17:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbc99341-966a-591b-abb1-eb2d0498aa24 with scrape type 1
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fbc99341-966a-591b-abb1-eb2d0498aa24 from tracking dictionaries
2026-01-28 17:09:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fbc99341-966a-591b-abb1-eb2d0498aa24 sending to next pipeline
2026-01-28 17:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbc99341-966a-591b-abb1-eb2d0498aa24, identifier: YK49893
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627b0210>
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg saved to cache
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a51590>
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_1aff4debc9adcae1107f9cf0599e2684.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1aff4debc9adcae1107f9cf0599e2684.jpg saved to cache
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b68de20e-7483-54fb-b052-a046d5b9c617 with identifier: AX39994
2026-01-28 17:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b68de20e-7483-54fb-b052-a046d5b9c617 with scrape type 2
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b68de20e-7483-54fb-b052-a046d5b9c617 with scrape type 2
2026-01-28 17:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b68de20e-7483-54fb-b052-a046d5b9c617, identifier: AX39994
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_2207bd19cc2c5264a6da995093d4ea60.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg not downloaded yet
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_b792359c125c6d9cfa4653d2a01506e4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b792359c125c6d9cfa4653d2a01506e4.jpg not downloaded yet
2026-01-28 17:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbc99341-966a-591b-abb1-eb2d0498aa24 with identifier: YK49893
2026-01-28 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbc99341-966a-591b-abb1-eb2d0498aa24 with identifier: YK49893
2026-01-28 17:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbc99341-966a-591b-abb1-eb2d0498aa24 with identifier: YK49893 to the API
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:53:10Z',
 'fuel_type': 'diesel',
 'id': 'fbc99341-966a-591b-abb1-eb2d0498aa24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK49893',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 86095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c80427c412620d2aeb0fa8536fd0e83d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_2945c5aca50e4fe35208aec652785168.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_ad181aa28112bba7c833ef4c4f4a9d0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_6a0a0f942a3b2d0bf8a2beb42f48ea4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_e8e3be77d46fbad22f88e51fb3ef0199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_64c520c51c42af4d9162e399a6e46af0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_4a4c89ffaad145c1fd523242fe49d785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_452694df09b653f8c04961f385e2957c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_0e5fce2202b86645fd12b8e86ad0d085.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3834d9210a8dbc402e01da27e272bb53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_d714593a539b5d961d17aa44b9f9429c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_3c5cc395be66eb8b94e6b31b6ead886d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_43f6a5864fd0c22c324926bfaa22e1c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_dda3f2354c2a7e46c99e643223800b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_c96ee720c06cb86a5cd2f785866e6a8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fbc99341-966a-591b-abb1-eb2d0498aa24/fbc99341-966a-591b-abb1-eb2d0498aa24_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/9e/8d9e9ddef1feb21c4b151a772c37e195/pa/YK49893_a8e342195cd0bfe56cf9bba619119db1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.5 dCi Energy Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2019}
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YK49893%27 HTTP/1.1" 200 None
2026-01-28 17:09:54 [auto1.es] INFO: Saving data for YK49893: {'created_time': 1769620194.708978, 'last_price_update_time': 1769620194.708989, 'auction_closing_time': 1769705590.0}
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YK49893') HTTP/1.1" 204 0
2026-01-28 17:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b68de20e-7483-54fb-b052-a046d5b9c617 with identifier: AX39994
2026-01-28 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b68de20e-7483-54fb-b052-a046d5b9c617 with identifier: AX39994
2026-01-28 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2026-01-28 17:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: b68de20e-7483-54fb-b052-a046d5b9c617 spider: auto1.es
2026-01-28 17:09:54 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b68de20e-7483-54fb-b052-a046d5b9c617 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-01-29T16:37:37Z',
 'fuel_type': 'diesel',
 'id': 'b68de20e-7483-54fb-b052-a046d5b9c617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX39994',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Toyota',
 'model': 'ProAce City',
 'odometer': 187082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-10',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Toyota ProAce City 1.5 D-4D Combi L1 GX',
 'transmission': 'manual',
 'trim': 'Combi L1 GX',
 'year': 2020}
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AX39994%27 HTTP/1.1" 200 None
2026-01-28 17:09:54 [auto1.es] INFO: Saving data for AX39994: {'auction_closing_time': 1769704657.0, 'created_time': 1769061735.504802, 'last_price_update_time': 1769620194.937461}
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AX39994') HTTP/1.1" 204 0
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_fae3dc616645936ea1d44790d21a9fda.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_fae3dc616645936ea1d44790d21a9fda.jpg not downloaded yet
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6298f150>
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_e31186ec565930eb66fc742ff80e40ce.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg saved to cache
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_f07f9f555120f044268ae99db8eaf590.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_348206e66b5206f9dd57c574faea1267.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg not downloaded yet
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_c08d94ee1eed966e9d7a276f336816b3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c08d94ee1eed966e9d7a276f336816b3.jpg not downloaded yet
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627b12d0>
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg saved to cache
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6343ac90>
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg saved to cache
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282fd10>
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_ba948b7b36711c1a442ad26c687db4bd.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_ba948b7b36711c1a442ad26c687db4bd.jpg saved to cache
2026-01-28 17:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629330d0>
2026-01-28 17:09:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg saved to cache
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ded90>
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_32df5ea16203866ed04759abc33b73cb.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_32df5ea16203866ed04759abc33b73cb.jpg saved to cache
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_a561a4c856382b47860d97748b52dcc0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_935229314c67ea3c0a589c2d58da3c1d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_c595d21d8d930b367ac92ce635eba3b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c595d21d8d930b367ac92ce635eba3b7.jpg not downloaded yet
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg not downloaded yet
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg not downloaded yet
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY06551/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL07550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_c8678af8d3cbd614aedff9a57663af22.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c8678af8d3cbd614aedff9a57663af22.jpg not downloaded yet
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_a3e5d601c56e51da7bedf05724a19671.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg not downloaded yet
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg not downloaded yet
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6358ce10>
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_f07f9f555120f044268ae99db8eaf590.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_f07f9f555120f044268ae99db8eaf590.jpg saved to cache
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63649f90>
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg saved to cache
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_171548069abf7d57b7caafd427420d1c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg not downloaded yet
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_65ee83415dc59998de255423e7b59a64.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_65ee83415dc59998de255423e7b59a64.jpg not downloaded yet
2026-01-28 17:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_671dc73afca671203ae4712078c836fa.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b792359c125c6d9cfa4653d2a01506e4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625dd650>
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_3a072101caad2ee5d565389080c1f100.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg saved to cache
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628817d0>
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_a561a4c856382b47860d97748b52dcc0.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_a561a4c856382b47860d97748b52dcc0.jpg saved to cache
2026-01-28 17:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625d26d0>
2026-01-28 17:09:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252F6e%252F186e0625597328aef9976abfd672c262%252Fpa%252FCC06310_935229314c67ea3c0a589c2d58da3c1d.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_935229314c67ea3c0a589c2d58da3c1d.jpg saved to cache
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 083bfa2f-8d75-5801-a30d-2104b136f327
2026-01-28 17:09:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 083bfa2f-8d75-5801-a30d-2104b136f327, skipping ID generation
2026-01-28 17:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 083bfa2f-8d75-5801-a30d-2104b136f327 with scrape type 1
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 083bfa2f-8d75-5801-a30d-2104b136f327 from tracking dictionaries
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 083bfa2f-8d75-5801-a30d-2104b136f327 sending to next pipeline
2026-01-28 17:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 083bfa2f-8d75-5801-a30d-2104b136f327, identifier: CC06310
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62328350>
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg saved to cache
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62883110>
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_9ddd751570ea20b028cccd78a8699f00.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg saved to cache
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9f48e93a67cf3a25714cc03b031f6710.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_69cc9f28b99e6654277f81a991f287b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg not downloaded yet
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg not downloaded yet
2026-01-28 17:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 083bfa2f-8d75-5801-a30d-2104b136f327 with identifier: CC06310
2026-01-28 17:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 083bfa2f-8d75-5801-a30d-2104b136f327 with identifier: CC06310
2026-01-28 17:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 083bfa2f-8d75-5801-a30d-2104b136f327 with identifier: CC06310 to the API
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_935229314c67ea3c0a589c2d58da3c1d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 310,
 'expiration_date': '2026-01-29T16:28:21Z',
 'fuel_type': 'petrol',
 'id': '083bfa2f-8d75-5801-a30d-2104b136f327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC06310',
 'listing': 'auction',
 'location': 'ES, Valladolid',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 28114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_011a82920e1cda01dfce9c8d357c6e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3ad56101495944965bf53ea7f27e6d36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_949c09b0f2b2549f5a71531795e5a046.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_935229314c67ea3c0a589c2d58da3c1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_c4fe3d7e9b800ed37530cd34db089880.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_0abcb58c5bc2592e6566bbb22ff9ac17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_96d9cde2e7565616862f2e5a9a3b69d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_22d85ba85153259c89ae02a12744a865.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_ec40a4de42bc346a8998ada083e7768d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_5b2713b8c23fa382c78e4cc71d20023a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_3f3bc0e941caf13daa0df7a0e5d7bdcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_a3ac80ab7e5ed65eb9e1bf025a547f91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54678,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_60977aa8764adb8f0c60a7af4cbbc25d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2ed463c70da50efc1389969c464013eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_2cd7fcccec6366f2e742d4e506dde0d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083bfa2f-8d75-5801-a30d-2104b136f327/083bfa2f-8d75-5801-a30d-2104b136f327_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/6e/186e0625597328aef9976abfd672c262/pa/CC06310_9652a3f2b909910a4766002d9bea9d35.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CC06310%27 HTTP/1.1" 200 None
2026-01-28 17:09:59 [auto1.es] INFO: Saving data for CC06310: {'created_time': 1769620199.31907, 'last_price_update_time': 1769620199.319081, 'auction_closing_time': 1769704101.0}
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CC06310') HTTP/1.1" 204 0
2026-01-28 17:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_fae3dc616645936ea1d44790d21a9fda.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_77e818025c154993bd7de587dacc4051.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg not downloaded yet
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg not downloaded yet
2026-01-28 17:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL81396> (referer: https://www.auto1.com/v1/car-details-view/EL81396/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636521d0>
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F29%252Ff929d455112b1d2355faea0952dffcd4%252Fpa%252FGE25563_671dc73afca671203ae4712078c836fa.jpg') HTTP/1.1" 204 0
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_671dc73afca671203ae4712078c836fa.jpg saved to cache
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b7723ddb-161a-5917-8885-edee46238869
2026-01-28 17:09:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b7723ddb-161a-5917-8885-edee46238869, skipping ID generation
2026-01-28 17:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7723ddb-161a-5917-8885-edee46238869 with scrape type 1
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b7723ddb-161a-5917-8885-edee46238869 from tracking dictionaries
2026-01-28 17:09:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b7723ddb-161a-5917-8885-edee46238869 sending to next pipeline
2026-01-28 17:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b7723ddb-161a-5917-8885-edee46238869, identifier: GE25563
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63491990>
2026-01-28 17:09:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg saved to cache
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625d9b50>
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_b792359c125c6d9cfa4653d2a01506e4.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b792359c125c6d9cfa4653d2a01506e4.jpg saved to cache
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c08d94ee1eed966e9d7a276f336816b3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b7723ddb-161a-5917-8885-edee46238869 with identifier: GE25563
2026-01-28 17:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b7723ddb-161a-5917-8885-edee46238869 with identifier: GE25563
2026-01-28 17:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157266 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157266
2026-01-28 17:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b7723ddb-161a-5917-8885-edee46238869 spider: auto1.es
2026-01-28 17:10:00 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b7723ddb-161a-5917-8885-edee46238869 due to rule: high_mileage_for_country.json, error: 157266 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157266
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-01-29T16:44:02Z',
 'fuel_type': 'petrol',
 'id': 'b7723ddb-161a-5917-8885-edee46238869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE25563',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 157266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52107,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_53fd5b02bd7c127ebdad2e4bee7a1679.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49875,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_a54ed683be6202c77132f4fce6af878c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52711,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8bddce08a5726663eeb2a2231ef756f3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41993,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_bea2c5d9632f10ffe2bf11024b9367cc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46273,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_9c7848d145a4c34553c662df4acef9e9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46644,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_2500cadad8cc20bdcdcceecccd0577c9.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38286,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_96c34b1daf1571abd6dacfed36569327.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47196,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_671dc73afca671203ae4712078c836fa.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48359,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_08b7fc714c05db71919b070e781f1a30.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44587,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_f07f9f555120f044268ae99db8eaf590.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45266,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_caf33f47bf2daf5ec0a93647482f2f2e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42313,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_09251f497784d130857fb5b4e2434908.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_ba948b7b36711c1a442ad26c687db4bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37064,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_8f35f716fdeaad258da17e1ebb3e9389.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_32df5ea16203866ed04759abc33b73cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b7723ddb-161a-5917-8885-edee46238869/b7723ddb-161a-5917-8885-edee46238869_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/29/f929d455112b1d2355faea0952dffcd4/pa/GE25563_1be491699988007bbc2c244fdf3f4b75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-04-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27GE25563%27 HTTP/1.1" 200 None
2026-01-28 17:10:00 [auto1.es] INFO: Saving data for GE25563: {'created_time': 1769620200.650936, 'last_price_update_time': 1769620200.650949, 'auction_closing_time': 1769705042.0}
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='GE25563') HTTP/1.1" 204 0
2026-01-28 17:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c595d21d8d930b367ac92ce635eba3b7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_c833bbe98025252c611416bca54d759e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c833bbe98025252c611416bca54d759e.jpg not downloaded yet
2026-01-28 17:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62576650>
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_9f48e93a67cf3a25714cc03b031f6710.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9f48e93a67cf3a25714cc03b031f6710.jpg saved to cache
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6255de90>
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252F94%252F31949230766852d71523da7add357293%252Fpa%252FYC21611_69cc9f28b99e6654277f81a991f287b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_69cc9f28b99e6654277f81a991f287b6.jpg saved to cache
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57635d99-fd19-5476-8521-5ef4619ca7e5
2026-01-28 17:10:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57635d99-fd19-5476-8521-5ef4619ca7e5, skipping ID generation
2026-01-28 17:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57635d99-fd19-5476-8521-5ef4619ca7e5 with scrape type 1
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 57635d99-fd19-5476-8521-5ef4619ca7e5 from tracking dictionaries
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57635d99-fd19-5476-8521-5ef4619ca7e5 sending to next pipeline
2026-01-28 17:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 57635d99-fd19-5476-8521-5ef4619ca7e5, identifier: YC21611
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272fcd0>
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_2207bd19cc2c5264a6da995093d4ea60.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg saved to cache
2026-01-28 17:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 57635d99-fd19-5476-8521-5ef4619ca7e5 with identifier: YC21611
2026-01-28 17:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 57635d99-fd19-5476-8521-5ef4619ca7e5 with identifier: YC21611
2026-01-28 17:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 57635d99-fd19-5476-8521-5ef4619ca7e5 with identifier: YC21611 to the API
2026-01-28 17:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_69cc9f28b99e6654277f81a991f287b6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:01:18Z',
 'fuel_type': 'diesel',
 'id': '57635d99-fd19-5476-8521-5ef4619ca7e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC21611',
 'listing': 'auction',
 'location': 'ES, Valencia',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 84617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f36347bcd96568785ce47320202a8b66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_3b4ea08f62a060edfda9a7874a3c13c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2387067,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_8515bc455fcc7c941d6c9ca00e6433cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_69cc9f28b99e6654277f81a991f287b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_688afcfb8f205103052376e91b84ce1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_11228300e0a9c9fcb0bfd1f22e5cdc68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_719ba8863d3bae6864fc5cb75b66adde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_1cedcd255615c09f2cf42bcb1d728c2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_759957d3523d9a44b7934aa434892326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_195559ad7925ad08080796fafce5c363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_a561a4c856382b47860d97748b52dcc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_83ca71b672c6c2ce7ed47bb9c8ba3018.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_f16d53f3f38f65d77bca888aba66fb1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_886471bae1326732e724b44d1bf2e547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_78ba78f7b256eef1b80a6d820f7901b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57635d99-fd19-5476-8521-5ef4619ca7e5/57635d99-fd19-5476-8521-5ef4619ca7e5_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/94/31949230766852d71523da7add357293/pa/YC21611_0b13097c7d0697ee25d98464086180ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2020}
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YC21611%27 HTTP/1.1" 200 None
2026-01-28 17:10:02 [auto1.es] INFO: Saving data for YC21611: {'created_time': 1769620202.2042, 'last_price_update_time': 1769620202.204212, 'auction_closing_time': 1769702478.0}
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YC21611') HTTP/1.1" 204 0
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg not downloaded yet
2026-01-28 17:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA44200> (referer: https://www.auto1.com/v1/car-details-view/ZA44200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP24592> (referer: https://www.auto1.com/v1/car-details-view/TP24592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625dbd90>
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_fae3dc616645936ea1d44790d21a9fda.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_fae3dc616645936ea1d44790d21a9fda.jpg saved to cache
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6813566-c3ea-58e6-b09b-10c20f76c640 with identifier: EL81396
2026-01-28 17:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6813566-c3ea-58e6-b09b-10c20f76c640 with scrape type 2
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6813566-c3ea-58e6-b09b-10c20f76c640 with scrape type 2
2026-01-28 17:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b6813566-c3ea-58e6-b09b-10c20f76c640, identifier: EL81396
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63470390>
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg saved to cache
2026-01-28 17:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b623233d0>
2026-01-28 17:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_c08d94ee1eed966e9d7a276f336816b3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c08d94ee1eed966e9d7a276f336816b3.jpg saved to cache
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624af590>
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_c595d21d8d930b367ac92ce635eba3b7.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c595d21d8d930b367ac92ce635eba3b7.jpg saved to cache
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62666910>
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg saved to cache
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_65ee83415dc59998de255423e7b59a64.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c8678af8d3cbd614aedff9a57663af22.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_e485154f5051c6ea1984d63a9de7663f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_e485154f5051c6ea1984d63a9de7663f.jpg not downloaded yet
2026-01-28 17:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b6813566-c3ea-58e6-b09b-10c20f76c640 with identifier: EL81396
2026-01-28 17:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b6813566-c3ea-58e6-b09b-10c20f76c640 with identifier: EL81396
2026-01-28 17:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194543 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194543
2026-01-28 17:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b6813566-c3ea-58e6-b09b-10c20f76c640 spider: auto1.es
2026-01-28 17:10:03 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: b6813566-c3ea-58e6-b09b-10c20f76c640 due to rule: high_mileage_for_country.json, error: 194543 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194543
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:45:48Z',
 'fuel_type': 'diesel',
 'id': 'b6813566-c3ea-58e6-b09b-10c20f76c640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL81396',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '3er',
 'odometer': 194543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2022}
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EL81396%27 HTTP/1.1" 200 None
2026-01-28 17:10:03 [auto1.es] INFO: Saving data for EL81396: {'auction_closing_time': 1769705148.0, 'created_time': 1769101369.733291, 'last_price_update_time': 1769620203.963795}
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EL81396') HTTP/1.1" 204 0
2026-01-28 17:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62581b90>
2026-01-28 17:10:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg saved to cache
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg not downloaded yet
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62521610>
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_348206e66b5206f9dd57c574faea1267.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg saved to cache
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 with identifier: ZA44200
2026-01-28 17:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 with scrape type 2
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 with scrape type 2
2026-01-28 17:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2, identifier: ZA44200
2026-01-28 17:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 with identifier: TP24592
2026-01-28 17:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 with scrape type 2
2026-01-28 17:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 with scrape type 2
2026-01-28 17:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44, identifier: TP24592
2026-01-28 17:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 with identifier: ZA44200
2026-01-28 17:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 with identifier: ZA44200
2026-01-28 17:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 spider: auto1.es
2026-01-28 17:10:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:02:02Z',
 'fuel_type': 'diesel',
 'id': 'bff1a2d3-9dfc-583e-a5bc-4e71fb3e20a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA44200',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 179798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Pro L1',
 'transmission': 'manual',
 'trim': 'Pro L1',
 'year': 2022}
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZA44200%27 HTTP/1.1" 200 None
2026-01-28 17:10:05 [auto1.es] INFO: Saving data for ZA44200: {'auction_closing_time': 1769702522.0, 'created_time': 1769061742.126365, 'last_price_update_time': 1769620205.055059}
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZA44200') HTTP/1.1" 204 0
2026-01-28 17:10:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 with identifier: TP24592
2026-01-28 17:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 with identifier: TP24592
2026-01-28 17:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
2026-01-28 17:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 spider: auto1.es
2026-01-28 17:10:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 36ad652d-be7e-5283-a5f9-ffa1dde1fe44 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'transit' containing 'transit'
{'auction_title': '',
 'c_o_2_emission_value': 196,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6A',
 'engine': '2.0L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:41:53Z',
 'fuel_type': 'diesel',
 'id': '36ad652d-be7e-5283-a5f9-ffa1dde1fe44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP24592',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 181813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-18',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2022}
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP24592%27 HTTP/1.1" 200 None
2026-01-28 17:10:05 [auto1.es] INFO: Saving data for TP24592: {'auction_closing_time': 1769704913.0, 'created_time': 1767872367.433878, 'last_price_update_time': 1769620205.28602}
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP24592') HTTP/1.1" 204 0
2026-01-28 17:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c833bbe98025252c611416bca54d759e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:05 [scrapy.extensions.logstats] INFO: Crawled 1260 pages (at 93 pages/min), scraped 340 items (at 25 items/min)
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_13672609746220c47c184ee174f89f74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_13672609746220c47c184ee174f89f74.jpg not downloaded yet
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a3dc10>
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_65ee83415dc59998de255423e7b59a64.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_65ee83415dc59998de255423e7b59a64.jpg saved to cache
2026-01-28 17:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a3cf90>
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg saved to cache
2026-01-28 17:10:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c6390>
2026-01-28 17:10:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_171548069abf7d57b7caafd427420d1c.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg saved to cache
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62523810>
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_c8678af8d3cbd614aedff9a57663af22.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c8678af8d3cbd614aedff9a57663af22.jpg saved to cache
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6283b310>
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg saved to cache
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_4892d52342a97efc1555d4548322a1a3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_4892d52342a97efc1555d4548322a1a3.jpg not downloaded yet
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633efe50>
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_a3e5d601c56e51da7bedf05724a19671.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg saved to cache
2026-01-28 17:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625233d0>
2026-01-28 17:10:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg saved to cache
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63651950>
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb1%252F8ab1c369fdef3637271f5e900f33ed59%252Fpa%252FWA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg saved to cache
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe
2026-01-28 17:10:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe, skipping ID generation
2026-01-28 17:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe with scrape type 1
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe from tracking dictionaries
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0aec5ced-8d33-5ddd-9bd6-eb33038323fe sending to next pipeline
2026-01-28 17:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe, identifier: WA73273
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c7ed0>
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_c833bbe98025252c611416bca54d759e.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c833bbe98025252c611416bca54d759e.jpg saved to cache
2026-01-28 17:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63323d50>
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg saved to cache
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8f2d0>
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg saved to cache
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288aa50>
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_77e818025c154993bd7de587dacc4051.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg saved to cache
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_080603db98f449cf0caced822d0fff0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_080603db98f449cf0caced822d0fff0c.jpg not downloaded yet
2026-01-28 17:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe with identifier: WA73273
2026-01-28 17:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe with identifier: WA73273
2026-01-28 17:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 177377 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177377
2026-01-28 17:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe spider: auto1.es
2026-01-28 17:10:08 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 0aec5ced-8d33-5ddd-9bd6-eb33038323fe due to rule: high_mileage_for_country.json, error: 177377 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    177377
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:15:01Z',
 'fuel_type': 'petrol',
 'id': '0aec5ced-8d33-5ddd-9bd6-eb33038323fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA73273',
 'listing': 'auction',
 'location': 'ES, Santa Marta de Tormes',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 177377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7839fb07bca5541b91ede78f87a598a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_7a58f9c680e4ae4d4fb0b73804ddc724.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_82634c016b84f498298a030720a5d529.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9d25dac2705a5926a7bdbfe0123056bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_771ec9e8044e2574cc8ab0de9c922d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_ffbe2a4d0c9d235d45a671009627a68c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_0fea6fa7043ad2110eb43da60a52bc76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1aff4debc9adcae1107f9cf0599e2684.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_cfd47a851d4f15fdd30a1620bc7fc761.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_08a7b4b7d8f8eebd71c134636b7ae9f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_1f0d0b742f6771f1a533cedcee31ec49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64958,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_9f48e93a67cf3a25714cc03b031f6710.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_6b99e57fdf15a6cebf0ad1205bf97944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_fae3dc616645936ea1d44790d21a9fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c595d21d8d930b367ac92ce635eba3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0aec5ced-8d33-5ddd-9bd6-eb33038323fe/0aec5ced-8d33-5ddd-9bd6-eb33038323fe_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79793,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b1/8ab1c369fdef3637271f5e900f33ed59/pa/WA73273_c8678af8d3cbd614aedff9a57663af22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Soul 1.6 GDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2018}
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WA73273%27 HTTP/1.1" 200 None
2026-01-28 17:10:08 [auto1.es] INFO: Saving data for WA73273: {'created_time': 1769620208.763651, 'last_price_update_time': 1769620208.763662, 'auction_closing_time': 1769703301.0}
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WA73273') HTTP/1.1" 204 0
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_7424684d79aab86c54ee87a8ee8435b2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_e485154f5051c6ea1984d63a9de7663f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cc31656b91b99b957b706086f044bdd0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg not downloaded yet
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM42176/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK29781/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE30408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL07550> (referer: https://www.auto1.com/v1/car-details-view/HL07550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6365d410>
2026-01-28 17:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg saved to cache
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg not downloaded yet
2026-01-28 17:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63519c50>
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg saved to cache
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62569310>
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_7424684d79aab86c54ee87a8ee8435b2.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_7424684d79aab86c54ee87a8ee8435b2.jpg saved to cache
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6232b710>
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_e485154f5051c6ea1984d63a9de7663f.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_e485154f5051c6ea1984d63a9de7663f.jpg saved to cache
2026-01-28 17:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628e6c10>
2026-01-28 17:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg10%252Fdd%252F10ddf2a3b821ce81b96188c947688aae%252Fpa%252FSW32457_cc31656b91b99b957b706086f044bdd0.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cc31656b91b99b957b706086f044bdd0.jpg saved to cache
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 563c563e-6d3c-56a6-987a-c5e4906c0715
2026-01-28 17:10:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 563c563e-6d3c-56a6-987a-c5e4906c0715, skipping ID generation
2026-01-28 17:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c563e-6d3c-56a6-987a-c5e4906c0715 with scrape type 1
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 563c563e-6d3c-56a6-987a-c5e4906c0715 from tracking dictionaries
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 563c563e-6d3c-56a6-987a-c5e4906c0715 sending to next pipeline
2026-01-28 17:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 563c563e-6d3c-56a6-987a-c5e4906c0715, identifier: SW32457
2026-01-28 17:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with identifier: HL07550
2026-01-28 17:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with scrape type 1
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_e62014956b6f3268fa877bce66d76f1b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e62014956b6f3268fa877bce66d76f1b.jpg not downloaded yet
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_01278efe6b60cf178cdb55c6386f945a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_01278efe6b60cf178cdb55c6386f945a.jpg not downloaded yet
2026-01-28 17:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 563c563e-6d3c-56a6-987a-c5e4906c0715 with identifier: SW32457
2026-01-28 17:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 563c563e-6d3c-56a6-987a-c5e4906c0715 with identifier: SW32457
2026-01-28 17:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 563c563e-6d3c-56a6-987a-c5e4906c0715 with identifier: SW32457 to the API
2026-01-28 17:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cc31656b91b99b957b706086f044bdd0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:54:39Z',
 'fuel_type': 'petrol',
 'id': '563c563e-6d3c-56a6-987a-c5e4906c0715',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW32457',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 39093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_d061d3611dcf3c7234252c85417d044c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9e88145d19bb315cc7434e125aab730a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a07a2b927445cdb7f41be7da8573023d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_f9e3eadd2f27e24e81cd526ef0d1ae0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_97a005bd553d0f9df6888bfe5675ef39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_917699508d8b7873a0754a55648e6fc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_883214431a84eb5dde86e33aebdd864a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cf6e889bdfa48c0efbe5f8f6452d147b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0c359666cb35b2bbd8b6311c61e94fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63332,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_4e4e5fa52b2540afeb2e7152765d4176.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_39baf523e56a42bc4c672b900b6d4199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_0ef387d3aaafe311e33fc0434ce6e46e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_a0eec903f86e9c05be6bcf2fa4ce3e5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_9bf6536ac86796d7fe66fa6bc58fa8c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cc31656b91b99b957b706086f044bdd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563c563e-6d3c-56a6-987a-c5e4906c0715/563c563e-6d3c-56a6-987a-c5e4906c0715_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img10/dd/10ddf2a3b821ce81b96188c947688aae/pa/SW32457_cffd915d00388d0300e2bc1b126f5968.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-11-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia XCeed 1.0 TGDI Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2022}
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SW32457%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [auto1.es] INFO: Saving data for SW32457: {'created_time': 1769620212.049328, 'last_price_update_time': 1769620212.04934, 'auction_closing_time': 1769705679.0}
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SW32457') HTTP/1.1" 204 0
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_13672609746220c47c184ee174f89f74.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_4892d52342a97efc1555d4548322a1a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_89e4bb510cbc399c0097c08d6891d119.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_89e4bb510cbc399c0097c08d6891d119.jpg not downloaded yet
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_080603db98f449cf0caced822d0fff0c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg not downloaded yet
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK93279/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EJ62656/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AH74484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY06551> (referer: https://www.auto1.com/v1/car-details-view/DY06551/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62874690>
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fc2%252F01c2d941e3678ed508b5a945e596c420%252Fpa%252FAK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg saved to cache
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 976e7815-8125-50af-b939-9eb370bb9693
2026-01-28 17:10:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 976e7815-8125-50af-b939-9eb370bb9693, skipping ID generation
2026-01-28 17:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 976e7815-8125-50af-b939-9eb370bb9693 with scrape type 1
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 976e7815-8125-50af-b939-9eb370bb9693 from tracking dictionaries
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 976e7815-8125-50af-b939-9eb370bb9693 sending to next pipeline
2026-01-28 17:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 976e7815-8125-50af-b939-9eb370bb9693, identifier: AK15257
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg not downloaded yet
2026-01-28 17:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 976e7815-8125-50af-b939-9eb370bb9693 with identifier: AK15257
2026-01-28 17:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 976e7815-8125-50af-b939-9eb370bb9693 with identifier: AK15257
2026-01-28 17:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.2 gdi line 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 74675, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ak15257', 'expiration_date': '2026-01-29t16:19:46z', 'origin_country_code': 'es', 'trim': 'line 4x2', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '976e7815-8125-50af-b939-9eb370bb9693', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 342248}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 111477}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 345647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 342753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 109708}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 353028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104334}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 405715}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 72121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67877}], 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 74675}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:19:46z',
     'fuel_type': 'petrol',
     'id': '976e7815-8125-50af-b939-9eb370bb9693',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ak15257',
     'listing': 'auction',
     'location': 'es',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 74675,
     'odometer_in_km': 74675,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 12,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 108967,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342248,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 111477,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 345647,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342753,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 109708,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 353028,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 104334,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 405715,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67871,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72121,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67877,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-25',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.2 gdi line 4x2',
     'transmission': 'manual',
     'trim': 'line 4x2',
     'year': 2023}
2026-01-28 17:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 976e7815-8125-50af-b939-9eb370bb9693 spider: auto1.es
2026-01-28 17:10:12 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 976e7815-8125-50af-b939-9eb370bb9693 due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 12, 'seller_name': None, 'price_includes_vat': True, 'title': 'ssangyong tivoli 1.2 gdi line 4x2', 'price': 0, 'currency': 'eur', 'make': 'ssangyong', 'model': 'tivoli', 'transmission': 'manual', 'odometer': 74675, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-25', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ak15257', 'expiration_date': '2026-01-29t16:19:46z', 'origin_country_code': 'es', 'trim': 'line 4x2', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 128, 'doors_number': 5, 'is_vat_deductible': True, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': None, 'id': '976e7815-8125-50af-b939-9eb370bb9693', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 108967}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 342248}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 111477}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 345647}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 342753}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 109708}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 353028}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 104334}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 405715}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg', 'Width': 2040, 'Height': 1530, 'Extension': 'jpg', 'FileSizeInBytes': 72121}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 67877}], 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'ssangyong tivoli', 'sanitized_make': 'ssangyong', 'odometer_in_km': 74675}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 31,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 128,
     'expiration_date': '2026-01-29t16:19:46z',
     'fuel_type': 'petrol',
     'id': '976e7815-8125-50af-b939-9eb370bb9693',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ak15257',
     'listing': 'auction',
     'location': 'es',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli',
     'model': 'tivoli',
     'odometer': 74675,
     'odometer_in_km': 74675,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 12,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 108967,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342248,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 111477,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 345647,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 342753,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 109708,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 353028,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 104334,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 405715,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67871,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 72121,
                 'Height': 1530,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg',
                 'Width': 2040},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 67877,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2023-06-25',
     'sanitized_make': 'ssangyong',
     'seats_number': 5,
     'seller_name': None,
     'title': 'ssangyong tivoli 1.2 gdi line 4x2',
     'transmission': 'manual',
     'trim': 'line 4x2',
     'year': 2023}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 128,
 'expiration_date': '2026-01-29T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '976e7815-8125-50af-b939-9eb370bb9693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK15257',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Ssangyong',
 'model': 'Tivoli',
 'odometer': 74675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_e31186ec565930eb66fc742ff80e40ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342248,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_3a072101caad2ee5d565389080c1f100.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_9ddd751570ea20b028cccd78a8699f00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 345647,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d5cfff8bc0f69f97989cf1a8eba0305b.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 342753,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_6498f2a2c8a47b27c4bfcc8e349b838a.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_2207bd19cc2c5264a6da995093d4ea60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353028,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_348206e66b5206f9dd57c574faea1267.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_d1ddc484736e5b6ca2b35bc3cf1ba29b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405715,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_a3e5d601c56e51da7bedf05724a19671.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_171548069abf7d57b7caafd427420d1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72121,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_761fb8d1e1997d2971efd1be2dd7a189.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_976e7815-8125-50af-b939-9eb370bb9693/976e7815-8125-50af-b939-9eb370bb9693_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/c2/01c2d941e3678ed508b5a945e596c420/pa/AK15257_77e818025c154993bd7de587dacc4051.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-06-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ssangyong Tivoli 1.2 GDI Line 4x2',
 'transmission': 'manual',
 'trim': 'Line 4x2',
 'year': 2023}
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AK15257%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [auto1.es] INFO: Saving data for AK15257: {'created_time': 1769620212.681544, 'last_price_update_time': 1769620212.681556, 'auction_closing_time': 1769703586.0}
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AK15257') HTTP/1.1" 204 0
2026-01-28 17:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg not downloaded yet
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634b1c90>
2026-01-28 17:10:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_13672609746220c47c184ee174f89f74.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_13672609746220c47c184ee174f89f74.jpg saved to cache
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636bdc90>
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_4892d52342a97efc1555d4548322a1a3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_4892d52342a97efc1555d4548322a1a3.jpg saved to cache
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aaf010>
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_080603db98f449cf0caced822d0fff0c.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_080603db98f449cf0caced822d0fff0c.jpg saved to cache
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 956adbaf-55a3-5889-a1aa-09f1908072a3 with identifier: DY06551
2026-01-28 17:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 956adbaf-55a3-5889-a1aa-09f1908072a3 with scrape type 2
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 956adbaf-55a3-5889-a1aa-09f1908072a3 with scrape type 2
2026-01-28 17:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 956adbaf-55a3-5889-a1aa-09f1908072a3, identifier: DY06551
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e62014956b6f3268fa877bce66d76f1b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 956adbaf-55a3-5889-a1aa-09f1908072a3 with identifier: DY06551
2026-01-28 17:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 956adbaf-55a3-5889-a1aa-09f1908072a3 with identifier: DY06551
2026-01-28 17:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 179798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179798
2026-01-28 17:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 956adbaf-55a3-5889-a1aa-09f1908072a3 spider: auto1.es
2026-01-28 17:10:13 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 956adbaf-55a3-5889-a1aa-09f1908072a3 due to rule: high_mileage_for_country.json, error: 179798 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    179798
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '956adbaf-55a3-5889-a1aa-09f1908072a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY06551',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 179798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DY06551%27 HTTP/1.1" 200 None
2026-01-28 17:10:13 [auto1.es] INFO: Saving data for DY06551: {'auction_closing_time': 1769705006.0, 'created_time': 1764176567.731479, 'last_price_update_time': 1769620213.82816}
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DY06551') HTTP/1.1" 204 0
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_01278efe6b60cf178cdb55c6386f945a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg not downloaded yet
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN10692/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE78584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM73013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN91376/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62709750>
2026-01-28 17:10:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_16.jpg HTTP/1.1" 201 0
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg saved to cache
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg not downloaded yet
2026-01-28 17:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6355c950>
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_e62014956b6f3268fa877bce66d76f1b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e62014956b6f3268fa877bce66d76f1b.jpg saved to cache
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg not downloaded yet
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a95c50>
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_17.jpg HTTP/1.1" 201 0
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg saved to cache
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6288a650>
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_18.jpg HTTP/1.1" 201 0
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_01278efe6b60cf178cdb55c6386f945a.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_01278efe6b60cf178cdb55c6386f945a.jpg saved to cache
2026-01-28 17:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg not downloaded yet
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6293ef90>
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_19.jpg HTTP/1.1" 201 0
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F0c%252F0b0ceda5ff13e1f5f3dee5f0998a11af%252Fpa%252FMH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg saved to cache
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item db5e0bea-8e70-592c-b733-7873a07d9bf0
2026-01-28 17:10:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db5e0bea-8e70-592c-b733-7873a07d9bf0, skipping ID generation
2026-01-28 17:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db5e0bea-8e70-592c-b733-7873a07d9bf0 with scrape type 1
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db5e0bea-8e70-592c-b733-7873a07d9bf0 from tracking dictionaries
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db5e0bea-8e70-592c-b733-7873a07d9bf0 sending to next pipeline
2026-01-28 17:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: db5e0bea-8e70-592c-b733-7873a07d9bf0, identifier: MH75346
2026-01-28 17:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: db5e0bea-8e70-592c-b733-7873a07d9bf0 with identifier: MH75346
2026-01-28 17:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: db5e0bea-8e70-592c-b733-7873a07d9bf0 with identifier: MH75346
2026-01-28 17:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: db5e0bea-8e70-592c-b733-7873a07d9bf0 with identifier: MH75346 to the API
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-01-29T16:23:32Z',
 'fuel_type': 'diesel',
 'id': 'db5e0bea-8e70-592c-b733-7873a07d9bf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH75346',
 'listing': 'auction',
 'location': 'ES',
 'make': 'BMW',
 'model': '5er',
 'odometer': 131184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_cfcb9c455f2192b0b2e2676a4e7a8dce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_7424684d79aab86c54ee87a8ee8435b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b792359c125c6d9cfa4653d2a01506e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c08d94ee1eed966e9d7a276f336816b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_2af7f1b40a739e4e1c1bcd1a6cc61842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_0f9baddda4aad80cdcd9bb105b2ac1da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_65ee83415dc59998de255423e7b59a64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_12e57a8f7e85ba73dca1844bf7933c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_b6eb9a85ecb87d72f27cab803420dc02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_c833bbe98025252c611416bca54d759e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_46aa9760c2396e9f561c1ce5d3cbbd93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_e485154f5051c6ea1984d63a9de7663f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_1eb413f1ba36c5c506dcab3562eea7f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_13672609746220c47c184ee174f89f74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_4892d52342a97efc1555d4548322a1a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_080603db98f449cf0caced822d0fff0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_d9a9380e5c626f13779959f5d0e31ad1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_fbc3157f335d7a642ca4fbfb0370906b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_01278efe6b60cf178cdb55c6386f945a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db5e0bea-8e70-592c-b733-7873a07d9bf0/db5e0bea-8e70-592c-b733-7873a07d9bf0_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/0c/0b0ceda5ff13e1f5f3dee5f0998a11af/pa/MH75346_a1b8f8e0ea45c64b99f6a62bac0bb91c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 540d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2022}
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27MH75346%27 HTTP/1.1" 200 None
2026-01-28 17:10:15 [auto1.es] INFO: Saving data for MH75346: {'created_time': 1769620215.769642, 'last_price_update_time': 1769620215.769653, 'auction_closing_time': 1769703812.0}
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='MH75346') HTTP/1.1" 204 0
2026-01-28 17:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_9bd78230e8b146bf64db3623f4f16519.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_9bd78230e8b146bf64db3623f4f16519.jpg not downloaded yet
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6275d410>
2026-01-28 17:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg saved to cache
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg not downloaded yet
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63526dd0>
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg saved to cache
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629df550>
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg saved to cache
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg not downloaded yet
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3d9045556879578360a564fd6faea16f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3d9045556879578360a564fd6faea16f.jpg not downloaded yet
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DH78566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f67d0>
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg saved to cache
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_d79c1094259462d0cedebd68e59fbc81.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_d79c1094259462d0cedebd68e59fbc81.jpg not downloaded yet
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL98070/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EM43105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE30408> (referer: https://www.auto1.com/v1/car-details-view/NE30408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AH74484> (referer: https://www.auto1.com/v1/car-details-view/AH74484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6262ded0>
2026-01-28 17:10:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg saved to cache
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg not downloaded yet
2026-01-28 17:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK29781> (referer: https://www.auto1.com/v1/car-details-view/PK29781/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3ca32b778b447a54dbd999d5e658b054.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3ca32b778b447a54dbd999d5e658b054.jpg not downloaded yet
2026-01-28 17:10:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2026-01-28 17:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596c59c0-1e88-5b98-b014-9a69b533370d with scrape type 2
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596c59c0-1e88-5b98-b014-9a69b533370d with scrape type 2
2026-01-28 17:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 596c59c0-1e88-5b98-b014-9a69b533370d, identifier: NE30408
2026-01-28 17:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b74df9-bb8f-59bc-acef-785de101b236 with identifier: AH74484
2026-01-28 17:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b74df9-bb8f-59bc-acef-785de101b236 with scrape type 2
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b74df9-bb8f-59bc-acef-785de101b236 with scrape type 2
2026-01-28 17:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f2b74df9-bb8f-59bc-acef-785de101b236, identifier: AH74484
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_4ae2b638f09a389b988679f91da1a389.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_4ae2b638f09a389b988679f91da1a389.jpg not downloaded yet
2026-01-28 17:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2026-01-28 17:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408
2026-01-28 17:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 596c59c0-1e88-5b98-b014-9a69b533370d with identifier: NE30408 to the API
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE30408>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:16:03Z',
 'fuel_type': 'hybrid',
 'id': '596c59c0-1e88-5b98-b014-9a69b533370d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE30408',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Honda',
 'model': 'HR-V',
 'odometer': 69109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda HR-V 1.5 i-MMD Hybrid Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NE30408%27 HTTP/1.1" 200 None
2026-01-28 17:10:17 [auto1.es] INFO: Saving data for NE30408: {'auction_closing_time': 1769703363.0, 'created_time': 1765447315.538843, 'last_price_update_time': 1769620217.877344}
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NE30408') HTTP/1.1" 204 0
2026-01-28 17:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f2b74df9-bb8f-59bc-acef-785de101b236 with identifier: AH74484
2026-01-28 17:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f2b74df9-bb8f-59bc-acef-785de101b236 with identifier: AH74484
2026-01-28 17:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153766 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153766
2026-01-28 17:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f2b74df9-bb8f-59bc-acef-785de101b236 spider: auto1.es
2026-01-28 17:10:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f2b74df9-bb8f-59bc-acef-785de101b236 due to rule: high_mileage_for_country.json, error: 153766 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153766
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:59:33Z',
 'fuel_type': 'diesel',
 'id': 'f2b74df9-bb8f-59bc-acef-785de101b236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH74484',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 153766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-11-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 1.5 Blue-HDi Bastille +',
 'transmission': 'automatic',
 'trim': 'Bastille +',
 'year': 2021}
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27AH74484%27 HTTP/1.1" 200 None
2026-01-28 17:10:18 [auto1.es] INFO: Saving data for AH74484: {'auction_closing_time': 1769705973.0, 'created_time': 1767780197.010132, 'last_price_update_time': 1769620218.112587}
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='AH74484') HTTP/1.1" 204 0
2026-01-28 17:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_d79c1094259462d0cedebd68e59fbc81.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3d9045556879578360a564fd6faea16f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_9bd78230e8b146bf64db3623f4f16519.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2026-01-28 17:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with scrape type 2
2026-01-28 17:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with scrape type 2
2026-01-28 17:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee, identifier: PK29781
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636f71d0>
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg saved to cache
2026-01-28 17:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260e690>
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg saved to cache
2026-01-28 17:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2026-01-28 17:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee with identifier: PK29781
2026-01-28 17:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199491
2026-01-28 17:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee spider: auto1.es
2026-01-28 17:10:18 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2f27d4f7-5eb8-57ad-8060-fa110d4462ee due to rule: high_mileage_for_country.json, error: 199491 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199491
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:00Z',
 'fuel_type': 'diesel',
 'id': '2f27d4f7-5eb8-57ad-8060-fa110d4462ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK29781',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 199491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sport BlueMotion',
 'year': 2018}
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PK29781%27 HTTP/1.1" 200 None
2026-01-28 17:10:18 [auto1.es] INFO: Saving data for PK29781: {'auction_closing_time': 1769703300.0, 'created_time': 1768298605.608164, 'last_price_update_time': 1769620218.933683}
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PK29781') HTTP/1.1" 204 0
2026-01-28 17:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62889e50>
2026-01-28 17:10:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_d79c1094259462d0cedebd68e59fbc81.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_d79c1094259462d0cedebd68e59fbc81.jpg saved to cache
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ee0d0>
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3d9045556879578360a564fd6faea16f.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3d9045556879578360a564fd6faea16f.jpg saved to cache
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62871810>
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_9bd78230e8b146bf64db3623f4f16519.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_9bd78230e8b146bf64db3623f4f16519.jpg saved to cache
2026-01-28 17:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KG10310/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_4ae2b638f09a389b988679f91da1a389.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK93279> (referer: https://www.auto1.com/v1/car-details-view/HK93279/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EJ62656> (referer: https://www.auto1.com/v1/car-details-view/EJ62656/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN91376> (referer: https://www.auto1.com/v1/car-details-view/FN91376/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW36856> (referer: https://www.auto1.com/v1/car-details-view/TW36856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE60546> (referer: https://www.auto1.com/v1/car-details-view/CE60546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM73013> (referer: https://www.auto1.com/v1/car-details-view/VM73013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625e1f10>
2026-01-28 17:10:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg saved to cache
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3ca32b778b447a54dbd999d5e658b054.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344f6d0>
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_4ae2b638f09a389b988679f91da1a389.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_4ae2b638f09a389b988679f91da1a389.jpg saved to cache
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 with identifier: HK93279
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96, identifier: HK93279
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 with identifier: EJ62656
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1, identifier: EJ62656
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc9471d-3f67-5d00-ac07-228571ec50fc with identifier: FN91376
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc9471d-3f67-5d00-ac07-228571ec50fc with scrape type 1
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg not downloaded yet
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91477007-f1b3-5c3f-8683-77a290095ef6 with identifier: TW36856
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91477007-f1b3-5c3f-8683-77a290095ef6 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91477007-f1b3-5c3f-8683-77a290095ef6 with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 91477007-f1b3-5c3f-8683-77a290095ef6, identifier: TW36856
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee321670-94fe-5b3c-ad35-55af5de641ed with identifier: CE60546
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee321670-94fe-5b3c-ad35-55af5de641ed with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee321670-94fe-5b3c-ad35-55af5de641ed with scrape type 2
2026-01-28 17:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ee321670-94fe-5b3c-ad35-55af5de641ed, identifier: CE60546
2026-01-28 17:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cacf5d2-a848-54f6-aea8-4dc85f350823 with identifier: VM73013
2026-01-28 17:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cacf5d2-a848-54f6-aea8-4dc85f350823 with scrape type 1
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3cacf5d2-a848-54f6-aea8-4dc85f350823
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_9c68e7765c17594424f85246ba07bad3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9c68e7765c17594424f85246ba07bad3.jpg already downloaded
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_910abeb66af29f8d2e35fde5965e06da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_910abeb66af29f8d2e35fde5965e06da.jpg already downloaded
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_dbf6ad69ccd05207d6016f6c5503dee0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dbf6ad69ccd05207d6016f6c5503dee0.jpg already downloaded
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_dd93e75ac7ecc06609fac9c974357fd5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dd93e75ac7ecc06609fac9c974357fd5.jpg already downloaded
2026-01-28 17:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_4b651d819e7379f9d46405d7ab66267d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_4b651d819e7379f9d46405d7ab66267d.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_397ae7f0d1225b70fe5b62a108bda23a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_397ae7f0d1225b70fe5b62a108bda23a.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_785c7bc9df49a23dbad8889d1d2cd7f9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_785c7bc9df49a23dbad8889d1d2cd7f9.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_e497e3de15471383d416a47609e395d3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_e497e3de15471383d416a47609e395d3.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_c5443f94068688c32efbe4fa7ca6bfc5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_c5443f94068688c32efbe4fa7ca6bfc5.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_9dd23084b82db9fe0580889ebb96e5f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9dd23084b82db9fe0580889ebb96e5f5.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_704f0b5058dfb56ade1a4b6578d96ce8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_704f0b5058dfb56ade1a4b6578d96ce8.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_07da2ce6f7e7f0668bb8c177c4c1d950.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_07da2ce6f7e7f0668bb8c177c4c1d950.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_d04826b7b78c22ec10c93e1223f43860.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d04826b7b78c22ec10c93e1223f43860.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_d77447b0671e79a9a89178bd09752486.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d77447b0671e79a9a89178bd09752486.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_9116487f7094f11aa36437bffd068d77.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9116487f7094f11aa36437bffd068d77.jpg already downloaded
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef63bcc4e77c6294a93e2ea7c9e72d%252Fpa%252FVM73013_8a79574c75b437e17dff407137fc3aa1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_8a79574c75b437e17dff407137fc3aa1.jpg already downloaded
2026-01-28 17:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3cacf5d2-a848-54f6-aea8-4dc85f350823, identifier: VM73013
2026-01-28 17:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 with identifier: HK93279
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 with identifier: HK93279
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 199031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199031
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 spider: auto1.es
2026-01-28 17:10:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 148e9fc1-09a2-59d7-83d6-9d2f7d98bc96 due to rule: high_mileage_for_country.json, error: 199031 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    199031
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:47:23Z',
 'fuel_type': 'diesel',
 'id': '148e9fc1-09a2-59d7-83d6-9d2f7d98bc96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK93279',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 199031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HK93279%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [auto1.es] INFO: Saving data for HK93279: {'auction_closing_time': 1769705243.0, 'created_time': 1768218688.1835, 'last_price_update_time': 1769620221.510138}
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HK93279') HTTP/1.1" 204 0
2026-01-28 17:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 with identifier: EJ62656
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 with identifier: EJ62656
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143490 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143490
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 spider: auto1.es
2026-01-28 17:10:21 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: dd7d0c13-fe50-5ade-9770-fe6051ffb3d1 due to rule: high_mileage_for_make.json, error: 143490 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143490
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:02:55Z',
 'fuel_type': 'diesel',
 'id': 'dd7d0c13-fe50-5ade-9770-fe6051ffb3d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ62656',
 'listing': 'auction',
 'location': 'ES, Aldaya',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 143490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 5008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2022}
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EJ62656%27 HTTP/1.1" 200 None
2026-01-28 17:10:21 [auto1.es] INFO: Saving data for EJ62656: {'auction_closing_time': 1769702575.0, 'created_time': 1768298842.145698, 'last_price_update_time': 1769620221.743465}
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EJ62656') HTTP/1.1" 204 0
2026-01-28 17:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 91477007-f1b3-5c3f-8683-77a290095ef6 with identifier: TW36856
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 91477007-f1b3-5c3f-8683-77a290095ef6 with identifier: TW36856
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 165740 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165740
2026-01-28 17:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 91477007-f1b3-5c3f-8683-77a290095ef6 spider: auto1.es
2026-01-28 17:10:22 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 91477007-f1b3-5c3f-8683-77a290095ef6 due to rule: high_mileage_for_country.json, error: 165740 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    165740
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:15:06Z',
 'fuel_type': 'petrol',
 'id': '91477007-f1b3-5c3f-8683-77a290095ef6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW36856',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 165740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2017}
2026-01-28 17:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TW36856%27 HTTP/1.1" 200 None
2026-01-28 17:10:22 [auto1.es] INFO: Saving data for TW36856: {'auction_closing_time': 1769703306.0, 'created_time': 1769014985.933138, 'last_price_update_time': 1769620222.039591}
2026-01-28 17:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TW36856') HTTP/1.1" 204 0
2026-01-28 17:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ee321670-94fe-5b3c-ad35-55af5de641ed with identifier: CE60546
2026-01-28 17:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ee321670-94fe-5b3c-ad35-55af5de641ed with identifier: CE60546
2026-01-28 17:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ee321670-94fe-5b3c-ad35-55af5de641ed with identifier: CE60546 to the API
2026-01-28 17:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CE60546>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:18:13Z',
 'fuel_type': 'diesel',
 'id': 'ee321670-94fe-5b3c-ad35-55af5de641ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE60546',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 130930,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi BeChic',
 'transmission': 'automatic',
 'trim': 'BeChic',
 'year': 2018}
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CE60546%27 HTTP/1.1" 200 None
2026-01-28 17:10:23 [auto1.es] INFO: Saving data for CE60546: {'auction_closing_time': 1769703493.0, 'created_time': 1769446868.349884, 'last_price_update_time': 1769620223.460474}
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CE60546') HTTP/1.1" 204 0
2026-01-28 17:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3cacf5d2-a848-54f6-aea8-4dc85f350823 with identifier: VM73013
2026-01-28 17:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3cacf5d2-a848-54f6-aea8-4dc85f350823 with identifier: VM73013
2026-01-28 17:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3cacf5d2-a848-54f6-aea8-4dc85f350823 with identifier: VM73013 to the API
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM73013>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:46:35Z',
 'fuel_type': 'petrol',
 'id': '3cacf5d2-a848-54f6-aea8-4dc85f350823',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM73013',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 100777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9c68e7765c17594424f85246ba07bad3.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_910abeb66af29f8d2e35fde5965e06da.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dbf6ad69ccd05207d6016f6c5503dee0.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dd93e75ac7ecc06609fac9c974357fd5.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_4b651d819e7379f9d46405d7ab66267d.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_397ae7f0d1225b70fe5b62a108bda23a.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_785c7bc9df49a23dbad8889d1d2cd7f9.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_e497e3de15471383d416a47609e395d3.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_c5443f94068688c32efbe4fa7ca6bfc5.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9dd23084b82db9fe0580889ebb96e5f5.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_704f0b5058dfb56ade1a4b6578d96ce8.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_07da2ce6f7e7f0668bb8c177c4c1d950.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d04826b7b78c22ec10c93e1223f43860.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d77447b0671e79a9a89178bd09752486.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9116487f7094f11aa36437bffd068d77.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_8a79574c75b437e17dff407137fc3aa1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9c68e7765c17594424f85246ba07bad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_910abeb66af29f8d2e35fde5965e06da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dbf6ad69ccd05207d6016f6c5503dee0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_dd93e75ac7ecc06609fac9c974357fd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_4b651d819e7379f9d46405d7ab66267d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_397ae7f0d1225b70fe5b62a108bda23a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_785c7bc9df49a23dbad8889d1d2cd7f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_e497e3de15471383d416a47609e395d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_c5443f94068688c32efbe4fa7ca6bfc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9dd23084b82db9fe0580889ebb96e5f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_704f0b5058dfb56ade1a4b6578d96ce8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_07da2ce6f7e7f0668bb8c177c4c1d950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d04826b7b78c22ec10c93e1223f43860.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_d77447b0671e79a9a89178bd09752486.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_9116487f7094f11aa36437bffd068d77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3cacf5d2-a848-54f6-aea8-4dc85f350823/3cacf5d2-a848-54f6-aea8-4dc85f350823_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88577,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef63bcc4e77c6294a93e2ea7c9e72d/pa/VM73013_8a79574c75b437e17dff407137fc3aa1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27VM73013%27 HTTP/1.1" 200 None
2026-01-28 17:10:23 [auto1.es] INFO: Saving data for VM73013: {'created_time': 1769620223.799034, 'last_price_update_time': 1769620223.799045, 'auction_closing_time': 1769705195.0}
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='VM73013') HTTP/1.1" 204 0
2026-01-28 17:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_89e4bb510cbc399c0097c08d6891d119.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_29e492ab86904da03f0ac74a88fe07c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_29e492ab86904da03f0ac74a88fe07c9.jpg not downloaded yet
2026-01-28 17:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_61cc769f5b09b9bdb4d1869c849348f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM42176> (referer: https://www.auto1.com/v1/car-details-view/BM42176/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_69a77330f760ca63fb4d17c7c22907f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_69a77330f760ca63fb4d17c7c22907f3.jpg not downloaded yet
2026-01-28 17:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63527b10>
2026-01-28 17:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_3ca32b778b447a54dbd999d5e658b054.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3ca32b778b447a54dbd999d5e658b054.jpg saved to cache
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627deed0>
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg saved to cache
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_e8579c1c42959b362b29a21465f08f5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_e8579c1c42959b362b29a21465f08f5d.jpg not downloaded yet
2026-01-28 17:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_1583a32790f38d63a94904530b866f62.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_1583a32790f38d63a94904530b866f62.jpg not downloaded yet
2026-01-28 17:10:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357a950>
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F3b%252Fcb3b7d162feceff2fa33001ee91d1b18%252Fpa%252FHL07550_89e4bb510cbc399c0097c08d6891d119.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_89e4bb510cbc399c0097c08d6891d119.jpg saved to cache
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f
2026-01-28 17:10:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f, skipping ID generation
2026-01-28 17:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with scrape type 1
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f from tracking dictionaries
2026-01-28 17:10:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f sending to next pipeline
2026-01-28 17:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f, identifier: HL07550
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6357b410>
2026-01-28 17:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_61cc769f5b09b9bdb4d1869c849348f5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_61cc769f5b09b9bdb4d1869c849348f5.jpg saved to cache
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635f8750>
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F09%252F6d09e0a3089ccd960f9e59f6d64eee38%252Fpa%252FUS72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg saved to cache
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e3c0ee2-2401-5488-8243-93374688c4c6
2026-01-28 17:10:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e3c0ee2-2401-5488-8243-93374688c4c6, skipping ID generation
2026-01-28 17:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3c0ee2-2401-5488-8243-93374688c4c6 with scrape type 1
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e3c0ee2-2401-5488-8243-93374688c4c6 from tracking dictionaries
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e3c0ee2-2401-5488-8243-93374688c4c6 sending to next pipeline
2026-01-28 17:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6e3c0ee2-2401-5488-8243-93374688c4c6, identifier: US72477
2026-01-28 17:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ef2983-cbf1-5ba9-a717-59edc6a55726 with identifier: BM42176
2026-01-28 17:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ef2983-cbf1-5ba9-a717-59edc6a55726 with scrape type 2
2026-01-28 17:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9ef2983-cbf1-5ba9-a717-59edc6a55726 with scrape type 2
2026-01-28 17:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f9ef2983-cbf1-5ba9-a717-59edc6a55726, identifier: BM42176
2026-01-28 17:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with identifier: HL07550
2026-01-28 17:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with identifier: HL07550
2026-01-28 17:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f with identifier: HL07550 to the API
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_89e4bb510cbc399c0097c08d6891d119.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-01-29T16:11:51Z',
 'fuel_type': 'diesel',
 'id': '6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL07550',
 'listing': 'auction',
 'location': 'ES, Terrassa',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 134818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e62014956b6f3268fa877bce66d76f1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2504083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_89e4bb510cbc399c0097c08d6891d119.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_0c1c5a72a03471a0b7492414f701a2bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_2c0d93cc98bb30a6e6d584ad1d609de7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_a6db599ba37ec6ed81d2b7d2e8f313dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3b79eb63e26ca09c7a80d31b32506a61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_cc0bc88ad147c6bdbedb33f640073e86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_b6cd51d9e94ee3a3c59a2b64e114d149.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_9bd78230e8b146bf64db3623f4f16519.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_335cb9cba6a4512e4a65312a3b16dba6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_e44f39f24fa71e8771d1e57ea07db6e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3d9045556879578360a564fd6faea16f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_d79c1094259462d0cedebd68e59fbc81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_525e3867ac8b395c2dbcd2cac378fd5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_3ca32b778b447a54dbd999d5e658b054.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f/6f35aa9a-458c-5f3e-aaf3-ccd2476b4e4f_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/3b/cb3b7d162feceff2fa33001ee91d1b18/pa/HL07550_4ae2b638f09a389b988679f91da1a389.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27HL07550%27 HTTP/1.1" 200 None
2026-01-28 17:10:25 [auto1.es] INFO: Saving data for HL07550: {'created_time': 1769620225.967991, 'last_price_update_time': 1769620225.968007, 'auction_closing_time': 1769703111.0}
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='HL07550') HTTP/1.1" 204 0
2026-01-28 17:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6e3c0ee2-2401-5488-8243-93374688c4c6 with identifier: US72477
2026-01-28 17:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6e3c0ee2-2401-5488-8243-93374688c4c6 with identifier: US72477
2026-01-28 17:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6e3c0ee2-2401-5488-8243-93374688c4c6 with identifier: US72477 to the API
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.9L',
 'engine_horse_power': 163,
 'expiration_date': '2026-01-29T16:33:23Z',
 'fuel_type': 'diesel',
 'id': '6e3c0ee2-2401-5488-8243-93374688c4c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US72477',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 65874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_61cc769f5b09b9bdb4d1869c849348f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ca73f1f21a2f4144d57d2418e785a6a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_38583c61007e53c80fd64bf1a1853fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_b4a834ea6425cf69c817491240a96374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86155,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_cd4fe6be36d00b43a4439cc9313e46f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_50902563915b9159bdf58d219dd598e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_9f6b20e58e29142298b52d4cba160a5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c79b0a356331914fb64c18fbfc6af9ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_c6c9e189d327fc4c0f1726c7c872a485.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_d2fdec5e6606426185e4350bc9b5b957.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_83b8dc50a65dadd0790633a41e6c394e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_e42f4a01738bc17e1f0ebb460a11750b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_ef80a6b26b1e779cd794963b29211ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_77d1e82a5f304ce15f454d4d55e697b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_313e6435c71386e1cb4198a99ae7d6c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e3c0ee2-2401-5488-8243-93374688c4c6/6e3c0ee2-2401-5488-8243-93374688c4c6_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/09/6d09e0a3089ccd960f9e59f6d64eee38/pa/US72477_48dfdb1b244e19ce034ce5e347cc7411.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27US72477%27 HTTP/1.1" 200 None
2026-01-28 17:10:26 [auto1.es] INFO: Saving data for US72477: {'created_time': 1769620226.377231, 'last_price_update_time': 1769620226.377242, 'auction_closing_time': 1769704403.0}
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='US72477') HTTP/1.1" 204 0
2026-01-28 17:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f9ef2983-cbf1-5ba9-a717-59edc6a55726 with identifier: BM42176
2026-01-28 17:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f9ef2983-cbf1-5ba9-a717-59edc6a55726 with identifier: BM42176
2026-01-28 17:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f9ef2983-cbf1-5ba9-a717-59edc6a55726 spider: auto1.es
2026-01-28 17:10:26 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f9ef2983-cbf1-5ba9-a717-59edc6a55726 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:02:18Z',
 'fuel_type': 'diesel',
 'id': 'f9ef2983-cbf1-5ba9-a717-59edc6a55726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM42176',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 161573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Shine M',
 'transmission': 'manual',
 'trim': 'Shine M',
 'year': 2020}
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM42176%27 HTTP/1.1" 200 None
2026-01-28 17:10:26 [auto1.es] INFO: Saving data for BM42176: {'auction_closing_time': 1769702538.0, 'created_time': 1768823852.723969, 'last_price_update_time': 1769620226.655609}
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM42176') HTTP/1.1" 204 0
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg not downloaded yet
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY07960/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DH78566> (referer: https://www.auto1.com/v1/car-details-view/DH78566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU83589> (referer: https://www.auto1.com/v1/car-details-view/YU83589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL98070> (referer: https://www.auto1.com/v1/car-details-view/SL98070/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EM43105> (referer: https://www.auto1.com/v1/car-details-view/EM43105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN10692> (referer: https://www.auto1.com/v1/car-details-view/NN10692/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628115d0>
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg saved to cache
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_29e492ab86904da03f0ac74a88fe07c9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_33af2938830a75f8660b2666b09297e5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_33af2938830a75f8660b2666b09297e5.jpg not downloaded yet
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE78584> (referer: https://www.auto1.com/v1/car-details-view/DE78584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg not downloaded yet
2026-01-28 17:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_e8579c1c42959b362b29a21465f08f5d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg not downloaded yet
2026-01-28 17:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02d5d27-46c1-5160-8700-084c9a844f3a with identifier: DH78566
2026-01-28 17:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02d5d27-46c1-5160-8700-084c9a844f3a with scrape type 1
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item a02d5d27-46c1-5160-8700-084c9a844f3a
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_7fd555061a57a419affa6094ab3bc828.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_7fd555061a57a419affa6094ab3bc828.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_86cc567d97d2059e71ea9e4c6cb85783.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_86cc567d97d2059e71ea9e4c6cb85783.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_6077f310906328bf2223429c8c619590.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_6077f310906328bf2223429c8c619590.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_18cd1f4cfb1e04d0cf593cf8971ab47b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_18cd1f4cfb1e04d0cf593cf8971ab47b.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_b51e935de1efbc3604b1f0b3718b92ee.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b51e935de1efbc3604b1f0b3718b92ee.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_d7783c1e73ccc014db0caddd649b19ec.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_d7783c1e73ccc014db0caddd649b19ec.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_ca6687ca1ea31b3bae9f80e0c55cdd4a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_ca6687ca1ea31b3bae9f80e0c55cdd4a.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_2224c66bb8d58085b97fbff9fd13985d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_2224c66bb8d58085b97fbff9fd13985d.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_4ea98ce677044b37e114c0f55e684aaf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_4ea98ce677044b37e114c0f55e684aaf.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_3a486285781bfa31dc28890d23db0287.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_3a486285781bfa31dc28890d23db0287.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_b722a854e6ab1d6893441aa0b26234c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b722a854e6ab1d6893441aa0b26234c3.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_0875a8d57ad1bd0af9d012c63e0b0d12.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_0875a8d57ad1bd0af9d012c63e0b0d12.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_03884fffb12671923433b78f18bd5237.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_03884fffb12671923433b78f18bd5237.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_45b698f33f47331563c9477dfea36e9e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_45b698f33f47331563c9477dfea36e9e.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_1ca8d36f639b95d57ebcc5290a912c7e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_1ca8d36f639b95d57ebcc5290a912c7e.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe0%252Fcbe0d0762dcc42442cbc9d0204e0082f%252Fpa%252FDH78566_b3177d6a15b12924087dce2a3e7def5d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b3177d6a15b12924087dce2a3e7def5d.jpg already downloaded
2026-01-28 17:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a02d5d27-46c1-5160-8700-084c9a844f3a, identifier: DH78566
2026-01-28 17:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83067d86-68f2-5c23-9e01-f692d0c897bd with identifier: YU83589
2026-01-28 17:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83067d86-68f2-5c23-9e01-f692d0c897bd with scrape type 1
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 83067d86-68f2-5c23-9e01-f692d0c897bd
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_7fc2e398c1df24965f572648dddbbf74.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_7fc2e398c1df24965f572648dddbbf74.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_8539118464fc63087b2ce58f0a9970f3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_8539118464fc63087b2ce58f0a9970f3.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_2d86045c37dedb0dc03afdc773cd65ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_2d86045c37dedb0dc03afdc773cd65ca.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_e20054a6ef2f9a93ed9889bff471d997.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_e20054a6ef2f9a93ed9889bff471d997.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_c1c7ca9c030525471b8f5c6dbd249790.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c1c7ca9c030525471b8f5c6dbd249790.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_586ab95216d075ddfb1767ec206ce7a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_586ab95216d075ddfb1767ec206ce7a2.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_c6d258f84093126569c2942d0e1dcbd4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c6d258f84093126569c2942d0e1dcbd4.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_5c895323cff3eef1a113abcf51b81399.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_5c895323cff3eef1a113abcf51b81399.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_ea822c0e675c1d8cd6ae02706932496a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_ea822c0e675c1d8cd6ae02706932496a.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_21b7f13aa81f3148b972bcb04002f75b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_21b7f13aa81f3148b972bcb04002f75b.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_9c44189e58efd8d208ef1e375f8cde11.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_9c44189e58efd8d208ef1e375f8cde11.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_d46408e861f907a026454d921753c997.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d46408e861f907a026454d921753c997.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_40c992a997b252956ee7b8b0a38887c9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_40c992a997b252956ee7b8b0a38887c9.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_d62151114dc042a6a5c4ce4670028760.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d62151114dc042a6a5c4ce4670028760.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_f213d3de7d445b213405c1ce5bb2a2ac.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_f213d3de7d445b213405c1ce5bb2a2ac.jpg already downloaded
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F84%252Fec8427b18069ecf056eef82d4d54f6d8%252Fpa%252FYU83589_d3c1dc9c832b84e51362558a024cd45d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d3c1dc9c832b84e51362558a024cd45d.jpg already downloaded
2026-01-28 17:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 83067d86-68f2-5c23-9e01-f692d0c897bd, identifier: YU83589
2026-01-28 17:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de8fc5e7-86a5-52c3-8fa1-908c1763c739 with identifier: SL98070
2026-01-28 17:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8fc5e7-86a5-52c3-8fa1-908c1763c739 with scrape type 1
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_2b0ad15e884771d44be17db056b5f08c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_2b0ad15e884771d44be17db056b5f08c.jpg not downloaded yet
2026-01-28 17:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22522573-78cc-57af-8713-c87f49237dc1 with identifier: EM43105
2026-01-28 17:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22522573-78cc-57af-8713-c87f49237dc1 with scrape type 2
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22522573-78cc-57af-8713-c87f49237dc1 with scrape type 2
2026-01-28 17:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 22522573-78cc-57af-8713-c87f49237dc1, identifier: EM43105
2026-01-28 17:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 402543a5-e1f1-52ee-b637-2859df0ac3fc with identifier: NN10692
2026-01-28 17:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402543a5-e1f1-52ee-b637-2859df0ac3fc with scrape type 1
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_01fff1675732872f7b6a60bf0e55a823.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_01fff1675732872f7b6a60bf0e55a823.jpg not downloaded yet
2026-01-28 17:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a02d5d27-46c1-5160-8700-084c9a844f3a with identifier: DH78566
2026-01-28 17:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a02d5d27-46c1-5160-8700-084c9a844f3a with identifier: DH78566
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a02d5d27-46c1-5160-8700-084c9a844f3a spider: auto1.es
2026-01-28 17:10:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a02d5d27-46c1-5160-8700-084c9a844f3a due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-01-29T16:08:17Z',
 'fuel_type': 'diesel',
 'id': 'a02d5d27-46c1-5160-8700-084c9a844f3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH78566',
 'listing': 'auction',
 'location': 'ES, Pedrola, Zaragoza',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 158897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_7fd555061a57a419affa6094ab3bc828.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_86cc567d97d2059e71ea9e4c6cb85783.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_6077f310906328bf2223429c8c619590.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_18cd1f4cfb1e04d0cf593cf8971ab47b.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b51e935de1efbc3604b1f0b3718b92ee.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_d7783c1e73ccc014db0caddd649b19ec.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_ca6687ca1ea31b3bae9f80e0c55cdd4a.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_2224c66bb8d58085b97fbff9fd13985d.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_4ea98ce677044b37e114c0f55e684aaf.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_3a486285781bfa31dc28890d23db0287.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b722a854e6ab1d6893441aa0b26234c3.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_0875a8d57ad1bd0af9d012c63e0b0d12.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_03884fffb12671923433b78f18bd5237.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_45b698f33f47331563c9477dfea36e9e.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_1ca8d36f639b95d57ebcc5290a912c7e.jpg',
                'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b3177d6a15b12924087dce2a3e7def5d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_7fd555061a57a419affa6094ab3bc828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_86cc567d97d2059e71ea9e4c6cb85783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_6077f310906328bf2223429c8c619590.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_18cd1f4cfb1e04d0cf593cf8971ab47b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b51e935de1efbc3604b1f0b3718b92ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_d7783c1e73ccc014db0caddd649b19ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_ca6687ca1ea31b3bae9f80e0c55cdd4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_2224c66bb8d58085b97fbff9fd13985d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_4ea98ce677044b37e114c0f55e684aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_3a486285781bfa31dc28890d23db0287.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b722a854e6ab1d6893441aa0b26234c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_0875a8d57ad1bd0af9d012c63e0b0d12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_03884fffb12671923433b78f18bd5237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_45b698f33f47331563c9477dfea36e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_1ca8d36f639b95d57ebcc5290a912c7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a02d5d27-46c1-5160-8700-084c9a844f3a/a02d5d27-46c1-5160-8700-084c9a844f3a_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e0/cbe0d0762dcc42442cbc9d0204e0082f/pa/DH78566_b3177d6a15b12924087dce2a3e7def5d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-06',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 Blue-HDi L1 Komfort',
 'transmission': 'manual',
 'trim': 'L1 Komfort',
 'year': 2018}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DH78566%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [auto1.es] INFO: Saving data for DH78566: {'created_time': 1769620228.155373, 'last_price_update_time': 1769620228.155383, 'auction_closing_time': 1769702897.0}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DH78566') HTTP/1.1" 204 0
2026-01-28 17:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 83067d86-68f2-5c23-9e01-f692d0c897bd with identifier: YU83589
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 83067d86-68f2-5c23-9e01-f692d0c897bd with identifier: YU83589
2026-01-28 17:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 83067d86-68f2-5c23-9e01-f692d0c897bd with identifier: YU83589 to the API
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU83589>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:57:13Z',
 'fuel_type': 'diesel',
 'id': '83067d86-68f2-5c23-9e01-f692d0c897bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU83589',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 133739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_7fc2e398c1df24965f572648dddbbf74.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_8539118464fc63087b2ce58f0a9970f3.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_2d86045c37dedb0dc03afdc773cd65ca.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_e20054a6ef2f9a93ed9889bff471d997.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c1c7ca9c030525471b8f5c6dbd249790.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_586ab95216d075ddfb1767ec206ce7a2.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c6d258f84093126569c2942d0e1dcbd4.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_5c895323cff3eef1a113abcf51b81399.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_ea822c0e675c1d8cd6ae02706932496a.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_21b7f13aa81f3148b972bcb04002f75b.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_9c44189e58efd8d208ef1e375f8cde11.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d46408e861f907a026454d921753c997.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_40c992a997b252956ee7b8b0a38887c9.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d62151114dc042a6a5c4ce4670028760.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_f213d3de7d445b213405c1ce5bb2a2ac.jpg',
                'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d3c1dc9c832b84e51362558a024cd45d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_7fc2e398c1df24965f572648dddbbf74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_8539118464fc63087b2ce58f0a9970f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_2d86045c37dedb0dc03afdc773cd65ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_e20054a6ef2f9a93ed9889bff471d997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c1c7ca9c030525471b8f5c6dbd249790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_586ab95216d075ddfb1767ec206ce7a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_c6d258f84093126569c2942d0e1dcbd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_5c895323cff3eef1a113abcf51b81399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_ea822c0e675c1d8cd6ae02706932496a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_21b7f13aa81f3148b972bcb04002f75b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_9c44189e58efd8d208ef1e375f8cde11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d46408e861f907a026454d921753c997.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_40c992a997b252956ee7b8b0a38887c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d62151114dc042a6a5c4ce4670028760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_f213d3de7d445b213405c1ce5bb2a2ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83067d86-68f2-5c23-9e01-f692d0c897bd/83067d86-68f2-5c23-9e01-f692d0c897bd_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/84/ec8427b18069ecf056eef82d4d54f6d8/pa/YU83589_d3c1dc9c832b84e51362558a024cd45d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2019}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU83589%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [auto1.es] INFO: Saving data for YU83589: {'created_time': 1769620228.502299, 'last_price_update_time': 1769620228.502314, 'auction_closing_time': 1769705833.0}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU83589') HTTP/1.1" 204 0
2026-01-28 17:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 22522573-78cc-57af-8713-c87f49237dc1 with identifier: EM43105
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 22522573-78cc-57af-8713-c87f49237dc1 with identifier: EM43105
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
2026-01-28 17:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 22522573-78cc-57af-8713-c87f49237dc1 spider: auto1.es
2026-01-28 17:10:28 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 22522573-78cc-57af-8713-c87f49237dc1 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroen' containing 'citroen' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-01-29T16:11:44Z',
 'fuel_type': 'diesel',
 'id': '22522573-78cc-57af-8713-c87f49237dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM43105',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 108224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-27',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi L1',
 'transmission': 'manual',
 'trim': 'L1',
 'year': 2017}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EM43105%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [auto1.es] INFO: Saving data for EM43105: {'auction_closing_time': 1769703104.0, 'created_time': 1767273592.01673, 'last_price_update_time': 1769620228.713661}
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EM43105') HTTP/1.1" 204 0
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_111ed88925250777ff574b1501de5a83.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_111ed88925250777ff574b1501de5a83.jpg not downloaded yet
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_c34c98ca26098388530d01ba305300fa.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c34c98ca26098388530d01ba305300fa.jpg not downloaded yet
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg not downloaded yet
2026-01-28 17:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_1583a32790f38d63a94904530b866f62.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_69a77330f760ca63fb4d17c7c22907f3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290c150>
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_29e492ab86904da03f0ac74a88fe07c9.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_29e492ab86904da03f0ac74a88fe07c9.jpg saved to cache
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e586504f-ab4b-5e77-9769-2faf151ae106 with identifier: DE78584
2026-01-28 17:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e586504f-ab4b-5e77-9769-2faf151ae106 with scrape type 1
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_6510a82601c7858e03e5235aba32f2d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_6510a82601c7858e03e5235aba32f2d6.jpg not downloaded yet
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625f1a90>
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_e8579c1c42959b362b29a21465f08f5d.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_e8579c1c42959b362b29a21465f08f5d.jpg saved to cache
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg not downloaded yet
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_f4caa89efa90f52581952a13ff687508.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_f4caa89efa90f52581952a13ff687508.jpg not downloaded yet
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg not downloaded yet
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg not downloaded yet
2026-01-28 17:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg not downloaded yet
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_8f9f4321652424a447275a0b397b2b62.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_8f9f4321652424a447275a0b397b2b62.jpg not downloaded yet
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_97c04a673cc374002197262ea34e7491.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_97c04a673cc374002197262ea34e7491.jpg not downloaded yet
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a95750>
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_1583a32790f38d63a94904530b866f62.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_1583a32790f38d63a94904530b866f62.jpg saved to cache
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62702c50>
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_69a77330f760ca63fb4d17c7c22907f3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_69a77330f760ca63fb4d17c7c22907f3.jpg saved to cache
2026-01-28 17:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_16009d76d8fdeb8202efd67e1110eccd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_16009d76d8fdeb8202efd67e1110eccd.jpg not downloaded yet
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg not downloaded yet
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg not downloaded yet
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK25722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_2b0ad15e884771d44be17db056b5f08c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_01fff1675732872f7b6a60bf0e55a823.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_21c7928be58d9bc3035f30cdf0107e12.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_21c7928be58d9bc3035f30cdf0107e12.jpg not downloaded yet
2026-01-28 17:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5ee50>
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg saved to cache
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63501710>
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg saved to cache
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_5efbbd019c4560d4b9f1903d91426402.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_5efbbd019c4560d4b9f1903d91426402.jpg not downloaded yet
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_5a5282b79aeabc79a384280252d16715.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5a5282b79aeabc79a384280252d16715.jpg not downloaded yet
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_41d02952fa083cfaa575005d586ab612.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_41d02952fa083cfaa575005d586ab612.jpg not downloaded yet
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH12996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_39445eb8750811371d352e8f2c90daa9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_39445eb8750811371d352e8f2c90daa9.jpg not downloaded yet
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_b29d7fd29583a81984c4256767c78a42.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_b29d7fd29583a81984c4256767c78a42.jpg not downloaded yet
2026-01-28 17:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY97566> (referer: https://www.auto1.com/v1/car-details-view/KY97566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU54882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KG10310> (referer: https://www.auto1.com/v1/car-details-view/KG10310/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN00147> (referer: https://www.auto1.com/v1/car-details-view/BN00147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RP39282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a2fa90>
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_2b0ad15e884771d44be17db056b5f08c.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_2b0ad15e884771d44be17db056b5f08c.jpg saved to cache
2026-01-28 17:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a9dad0>
2026-01-28 17:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_01fff1675732872f7b6a60bf0e55a823.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_01fff1675732872f7b6a60bf0e55a823.jpg saved to cache
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6280a450>
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg saved to cache
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg not downloaded yet
2026-01-28 17:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_8f9f4321652424a447275a0b397b2b62.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg not downloaded yet
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_7d908d14306117918338b7a9de11357b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_7d908d14306117918338b7a9de11357b.jpg not downloaded yet
2026-01-28 17:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_16009d76d8fdeb8202efd67e1110eccd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_376a73da6250b14f4732661e70e9e0ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_376a73da6250b14f4732661e70e9e0ef.jpg not downloaded yet
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63374290>
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg saved to cache
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-01-28 17:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with scrape type 2
2026-01-28 17:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with scrape type 2
2026-01-28 17:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503, identifier: KY97566
2026-01-28 17:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2026-01-28 17:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0caad4fe-b952-5f46-a607-4a35dc719925 with scrape type 2
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0caad4fe-b952-5f46-a607-4a35dc719925 with scrape type 2
2026-01-28 17:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0caad4fe-b952-5f46-a607-4a35dc719925, identifier: KG10310
2026-01-28 17:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f10572a-89ab-5c94-81a0-cd69654ffd84 with identifier: BN00147
2026-01-28 17:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f10572a-89ab-5c94-81a0-cd69654ffd84 with scrape type 1
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3f10572a-89ab-5c94-81a0-cd69654ffd84
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_9618c1750447476e517e61a24aa99725.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_9618c1750447476e517e61a24aa99725.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_d7c4b17e8a77febeb9cb2fe541646ae7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d7c4b17e8a77febeb9cb2fe541646ae7.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_6d79e843ec453a7f7363b3d2e956eae4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6d79e843ec453a7f7363b3d2e956eae4.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_394d029ca50c79649acda5a60047be8f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_394d029ca50c79649acda5a60047be8f.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_74a8ccffd0a2211af7143b2b0f12440a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_74a8ccffd0a2211af7143b2b0f12440a.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_7446b5b4c8844d8300e1f4b2512bb81d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7446b5b4c8844d8300e1f4b2512bb81d.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_7fa6384e4b925f6c231797124ef6eb3e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7fa6384e4b925f6c231797124ef6eb3e.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_a03eed0fa80742a45007b00dc00d8755.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a03eed0fa80742a45007b00dc00d8755.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_d2fe734f1a1b1e09a0fe8eb963edac7a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d2fe734f1a1b1e09a0fe8eb963edac7a.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_6443f19b20db4ed0702f3f891077f5cb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6443f19b20db4ed0702f3f891077f5cb.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_de9981da076235597d892ac08858f84e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_de9981da076235597d892ac08858f84e.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_85fbedd9766e487a5ef2a8bfc3d0a182.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_85fbedd9766e487a5ef2a8bfc3d0a182.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_12a10a998e94b28f5eb259b1b3011d54.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_12a10a998e94b28f5eb259b1b3011d54.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_7f66d0239f0e2ab5e2839a085ce05157.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7f66d0239f0e2ab5e2839a085ce05157.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_a7c79eb4f2b9be5380b963aacad54605.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a7c79eb4f2b9be5380b963aacad54605.jpg already downloaded
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb5%252F90b572780e5a57036b9c0e6f5d8d372a%252Fpa%252FBN00147_873d99f1d6b20e93bfab4377b2a691c8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_873d99f1d6b20e93bfab4377b2a691c8.jpg already downloaded
2026-01-28 17:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3f10572a-89ab-5c94-81a0-cd69654ffd84, identifier: BN00147
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg not downloaded yet
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg not downloaded yet
2026-01-28 17:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-01-28 17:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 with identifier: KY97566
2026-01-28 17:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159402 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159402
2026-01-28 17:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 spider: auto1.es
2026-01-28 17:10:32 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 837b8bf0-e6a0-55c5-bf3b-778dc78cd503 due to rule: high_mileage_for_country.json, error: 159402 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159402
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:27:39Z',
 'fuel_type': 'diesel',
 'id': '837b8bf0-e6a0-55c5-bf3b-778dc78cd503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY97566',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 159402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-23',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Xcellence Travel Edition',
 'transmission': 'automatic',
 'trim': 'Xcellence Travel Edition',
 'year': 2019}
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY97566%27 HTTP/1.1" 200 None
2026-01-28 17:10:32 [auto1.es] INFO: Saving data for KY97566: {'auction_closing_time': 1769704059.0, 'created_time': 1766585569.90571, 'last_price_update_time': 1769620232.817696}
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KY97566') HTTP/1.1" 204 0
2026-01-28 17:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2026-01-28 17:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310
2026-01-28 17:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0caad4fe-b952-5f46-a607-4a35dc719925 with identifier: KG10310 to the API
2026-01-28 17:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KG10310>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 180,
 'expiration_date': '2026-01-29T16:31:38Z',
 'fuel_type': 'diesel',
 'id': '0caad4fe-b952-5f46-a607-4a35dc719925',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG10310',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 122611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Super 2WD',
 'transmission': 'automatic',
 'trim': 'Super 2WD',
 'year': 2018}
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KG10310%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [auto1.es] INFO: Saving data for KG10310: {'auction_closing_time': 1769704298.0, 'created_time': 1767873014.808808, 'last_price_update_time': 1769620233.291662}
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KG10310') HTTP/1.1" 204 0
2026-01-28 17:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3f10572a-89ab-5c94-81a0-cd69654ffd84 with identifier: BN00147
2026-01-28 17:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3f10572a-89ab-5c94-81a0-cd69654ffd84 with identifier: BN00147
2026-01-28 17:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3f10572a-89ab-5c94-81a0-cd69654ffd84 with identifier: BN00147 to the API
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BN00147>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:09:04Z',
 'fuel_type': 'petrol',
 'id': '3f10572a-89ab-5c94-81a0-cd69654ffd84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN00147',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 38945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_9618c1750447476e517e61a24aa99725.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d7c4b17e8a77febeb9cb2fe541646ae7.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6d79e843ec453a7f7363b3d2e956eae4.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_394d029ca50c79649acda5a60047be8f.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_74a8ccffd0a2211af7143b2b0f12440a.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7446b5b4c8844d8300e1f4b2512bb81d.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7fa6384e4b925f6c231797124ef6eb3e.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a03eed0fa80742a45007b00dc00d8755.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d2fe734f1a1b1e09a0fe8eb963edac7a.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6443f19b20db4ed0702f3f891077f5cb.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_de9981da076235597d892ac08858f84e.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_85fbedd9766e487a5ef2a8bfc3d0a182.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_12a10a998e94b28f5eb259b1b3011d54.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7f66d0239f0e2ab5e2839a085ce05157.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a7c79eb4f2b9be5380b963aacad54605.jpg',
                'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_873d99f1d6b20e93bfab4377b2a691c8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_9618c1750447476e517e61a24aa99725.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d7c4b17e8a77febeb9cb2fe541646ae7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6d79e843ec453a7f7363b3d2e956eae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_394d029ca50c79649acda5a60047be8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_74a8ccffd0a2211af7143b2b0f12440a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7446b5b4c8844d8300e1f4b2512bb81d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7fa6384e4b925f6c231797124ef6eb3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a03eed0fa80742a45007b00dc00d8755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_d2fe734f1a1b1e09a0fe8eb963edac7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_6443f19b20db4ed0702f3f891077f5cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_de9981da076235597d892ac08858f84e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_85fbedd9766e487a5ef2a8bfc3d0a182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_12a10a998e94b28f5eb259b1b3011d54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_7f66d0239f0e2ab5e2839a085ce05157.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_a7c79eb4f2b9be5380b963aacad54605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f10572a-89ab-5c94-81a0-cd69654ffd84/3f10572a-89ab-5c94-81a0-cd69654ffd84_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b5/90b572780e5a57036b9c0e6f5d8d372a/pa/BN00147_873d99f1d6b20e93bfab4377b2a691c8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xperience',
 'transmission': 'automatic',
 'trim': 'Xperience',
 'year': 2023}
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BN00147%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [auto1.es] INFO: Saving data for BN00147: {'created_time': 1769620233.618929, 'last_price_update_time': 1769620233.61894, 'auction_closing_time': 1769702944.0}
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BN00147') HTTP/1.1" 204 0
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_5efbbd019c4560d4b9f1903d91426402.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_10440a1e4da9b591db1c30514ffc48f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_10440a1e4da9b591db1c30514ffc48f0.jpg not downloaded yet
2026-01-28 17:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5a5282b79aeabc79a384280252d16715.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_45857340239d1e8e7d076b52b479e7a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_45857340239d1e8e7d076b52b479e7a5.jpg not downloaded yet
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg not downloaded yet
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM42464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WH17991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_21c7928be58d9bc3035f30cdf0107e12.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_41d02952fa083cfaa575005d586ab612.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg not downloaded yet
2026-01-28 17:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629a2a50>
2026-01-28 17:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_8f9f4321652424a447275a0b397b2b62.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_8f9f4321652424a447275a0b397b2b62.jpg saved to cache
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6257d150>
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg saved to cache
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a00e10>
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_16009d76d8fdeb8202efd67e1110eccd.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_16009d76d8fdeb8202efd67e1110eccd.jpg saved to cache
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_4253451b58a79d16c83864bd9db69328.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_4253451b58a79d16c83864bd9db69328.jpg not downloaded yet
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_450f8f3aeddac02851872c73e5039f07.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_450f8f3aeddac02851872c73e5039f07.jpg not downloaded yet
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg not downloaded yet
2026-01-28 17:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_b29d7fd29583a81984c4256767c78a42.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg not downloaded yet
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_895a40df6fce87feec38110c4896da53.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_895a40df6fce87feec38110c4896da53.jpg not downloaded yet
2026-01-28 17:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG76395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62703510>
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg saved to cache
2026-01-28 17:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a5ced0>
2026-01-28 17:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_5efbbd019c4560d4b9f1903d91426402.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_5efbbd019c4560d4b9f1903d91426402.jpg saved to cache
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63376490>
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_5a5282b79aeabc79a384280252d16715.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5a5282b79aeabc79a384280252d16715.jpg saved to cache
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625766d0>
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg saved to cache
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e01d0>
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_21c7928be58d9bc3035f30cdf0107e12.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_21c7928be58d9bc3035f30cdf0107e12.jpg saved to cache
2026-01-28 17:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626c7410>
2026-01-28 17:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_41d02952fa083cfaa575005d586ab612.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_41d02952fa083cfaa575005d586ab612.jpg saved to cache
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e7f10>
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg saved to cache
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_38828ab26668aed00327568d8d11838b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_38828ab26668aed00327568d8d11838b.jpg not downloaded yet
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg not downloaded yet
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg not downloaded yet
2026-01-28 17:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_7d908d14306117918338b7a9de11357b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg not downloaded yet
2026-01-28 17:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU19179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6369ac10>
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg saved to cache
2026-01-28 17:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634770d0>
2026-01-28 17:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_b29d7fd29583a81984c4256767c78a42.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_b29d7fd29583a81984c4256767c78a42.jpg saved to cache
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_376a73da6250b14f4732661e70e9e0ef.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_4253451b58a79d16c83864bd9db69328.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_ed6c247c0ad45944b6abacc4548359d4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ed6c247c0ad45944b6abacc4548359d4.jpg not downloaded yet
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg not downloaded yet
2026-01-28 17:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_10440a1e4da9b591db1c30514ffc48f0.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_450f8f3aeddac02851872c73e5039f07.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg not downloaded yet
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg not downloaded yet
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6a3a5490>
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg saved to cache
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6298cc10>
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg saved to cache
2026-01-28 17:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b625b0d90>
2026-01-28 17:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_7d908d14306117918338b7a9de11357b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_7d908d14306117918338b7a9de11357b.jpg saved to cache
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_38828ab26668aed00327568d8d11838b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU54882> (referer: https://www.auto1.com/v1/car-details-view/YU54882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH12996> (referer: https://www.auto1.com/v1/car-details-view/TH12996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_d8f65c2a3c1831898118293b5598850d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_d8f65c2a3c1831898118293b5598850d.jpg not downloaded yet
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_572156269131e736cc414531709389c1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_572156269131e736cc414531709389c1.jpg not downloaded yet
2026-01-28 17:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635e7c90>
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_376a73da6250b14f4732661e70e9e0ef.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_376a73da6250b14f4732661e70e9e0ef.jpg saved to cache
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a0f2d0>
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg saved to cache
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629cf290>
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_4253451b58a79d16c83864bd9db69328.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_4253451b58a79d16c83864bd9db69328.jpg saved to cache
2026-01-28 17:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62666950>
2026-01-28 17:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_10440a1e4da9b591db1c30514ffc48f0.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_10440a1e4da9b591db1c30514ffc48f0.jpg saved to cache
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_895a40df6fce87feec38110c4896da53.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RP39282> (referer: https://www.auto1.com/v1/car-details-view/RP39282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK17847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK25722> (referer: https://www.auto1.com/v1/car-details-view/FK25722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62454890>
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_450f8f3aeddac02851872c73e5039f07.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_450f8f3aeddac02851872c73e5039f07.jpg saved to cache
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6283be90>
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg saved to cache
2026-01-28 17:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6272aa50>
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg saved to cache
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ed6c247c0ad45944b6abacc4548359d4.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b626928d0>
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_38828ab26668aed00327568d8d11838b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_38828ab26668aed00327568d8d11838b.jpg saved to cache
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with identifier: YU54882
2026-01-28 17:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with scrape type 2
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with scrape type 2
2026-01-28 17:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee, identifier: YU54882
2026-01-28 17:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78123329-a8b6-54ed-993c-ba8eafa8b480 with identifier: TH12996
2026-01-28 17:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78123329-a8b6-54ed-993c-ba8eafa8b480 with scrape type 2
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78123329-a8b6-54ed-993c-ba8eafa8b480 with scrape type 2
2026-01-28 17:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 78123329-a8b6-54ed-993c-ba8eafa8b480, identifier: TH12996
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e1f10>
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg saved to cache
2026-01-28 17:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a32590>
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg saved to cache
2026-01-28 17:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with identifier: YU54882
2026-01-28 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with identifier: YU54882
2026-01-28 17:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 63d60a00-9f25-5d59-a8a2-e9f5f43a66ee with identifier: YU54882 to the API
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YU54882>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 130,
 'expiration_date': '2026-01-29T16:07:57Z',
 'fuel_type': 'petrol',
 'id': '63d60a00-9f25-5d59-a8a2-e9f5f43a66ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU54882',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 108163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.2 e-THP Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YU54882%27 HTTP/1.1" 200 None
2026-01-28 17:10:41 [auto1.es] INFO: Saving data for YU54882: {'auction_closing_time': 1769702877.0, 'created_time': 1768716033.323078, 'last_price_update_time': 1769620241.653763}
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YU54882') HTTP/1.1" 204 0
2026-01-28 17:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 78123329-a8b6-54ed-993c-ba8eafa8b480 with identifier: TH12996
2026-01-28 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 78123329-a8b6-54ed-993c-ba8eafa8b480 with identifier: TH12996
2026-01-28 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 78123329-a8b6-54ed-993c-ba8eafa8b480 spider: auto1.es
2026-01-28 17:10:41 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 78123329-a8b6-54ed-993c-ba8eafa8b480 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:31:30Z',
 'fuel_type': 'diesel',
 'id': '78123329-a8b6-54ed-993c-ba8eafa8b480',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH12996',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 172384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Business L2',
 'transmission': 'manual',
 'trim': 'Business L2',
 'year': 2018}
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TH12996%27 HTTP/1.1" 200 None
2026-01-28 17:10:41 [auto1.es] INFO: Saving data for TH12996: {'auction_closing_time': 1769704290.0, 'created_time': 1768550433.657277, 'last_price_update_time': 1769620241.866585}
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TH12996') HTTP/1.1" 204 0
2026-01-28 17:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635d4150>
2026-01-28 17:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_895a40df6fce87feec38110c4896da53.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_895a40df6fce87feec38110c4896da53.jpg saved to cache
2026-01-28 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f30f0cef-7384-56c0-b138-e174e0b374cb with identifier: RP39282
2026-01-28 17:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f30f0cef-7384-56c0-b138-e174e0b374cb with scrape type 2
2026-01-28 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f30f0cef-7384-56c0-b138-e174e0b374cb with scrape type 2
2026-01-28 17:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: f30f0cef-7384-56c0-b138-e174e0b374cb, identifier: RP39282
2026-01-28 17:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e14c33a-f3c0-5c70-853a-93af437587ab with identifier: FK25722
2026-01-28 17:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e14c33a-f3c0-5c70-853a-93af437587ab with scrape type 2
2026-01-28 17:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e14c33a-f3c0-5c70-853a-93af437587ab with scrape type 2
2026-01-28 17:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 5e14c33a-f3c0-5c70-853a-93af437587ab, identifier: FK25722
2026-01-28 17:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_45857340239d1e8e7d076b52b479e7a5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: f30f0cef-7384-56c0-b138-e174e0b374cb with identifier: RP39282
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: f30f0cef-7384-56c0-b138-e174e0b374cb with identifier: RP39282
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175646
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f30f0cef-7384-56c0-b138-e174e0b374cb spider: auto1.es
2026-01-28 17:10:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: f30f0cef-7384-56c0-b138-e174e0b374cb due to rule: high_mileage_for_country.json, error: 175646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175646
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 325,
 'expiration_date': '2026-01-29T16:59:58Z',
 'fuel_type': 'diesel',
 'id': 'f30f0cef-7384-56c0-b138-e174e0b374cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP39282',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 175646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RP39282%27 HTTP/1.1" 200 None
2026-01-28 17:10:42 [auto1.es] INFO: Saving data for RP39282: {'auction_closing_time': 1769705998.0, 'created_time': 1767186246.230911, 'last_price_update_time': 1769620242.561895}
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RP39282') HTTP/1.1" 204 0
2026-01-28 17:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 5e14c33a-f3c0-5c70-853a-93af437587ab with identifier: FK25722
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 5e14c33a-f3c0-5c70-853a-93af437587ab with identifier: FK25722
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 81617, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk25722', 'expiration_date': '2026-01-29t16:31:01z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '5e14c33a-f3c0-5c70-853a-93af437587ab', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 81617}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'green',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:31:01z',
     'fuel_type': 'petrol',
     'id': '5e14c33a-f3c0-5c70-853a-93af437587ab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk25722',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 81617,
     'odometer_in_km': 81617,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
2026-01-28 17:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 5e14c33a-f3c0-5c70-853a-93af437587ab spider: auto1.es
2026-01-28 17:10:42 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 5e14c33a-f3c0-5c70-853a-93af437587ab due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 2008 1.2 puretech allure', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '2008', 'transmission': 'manual', 'odometer': 81617, 'odometer_reading_unit': 'km', 'registration_date': '2017-04-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk25722', 'expiration_date': '2026-01-29t16:31:01z', 'origin_country_code': 'es', 'trim': 'allure', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, esquivias', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 103, 'id': '5e14c33a-f3c0-5c70-853a-93af437587ab', 'current_year_diff': 9, 'age_in_months': 105, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 81617}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 105,
     'auction_title': '',
     'c_o_2_emission_value': 103,
     'category': None,
     'color': 'green',
     'currency': 'eur',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:31:01z',
     'fuel_type': 'petrol',
     'id': '5e14c33a-f3c0-5c70-853a-93af437587ab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/fk25722',
     'listing': 'auction',
     'location': 'es, esquivias',
     'make': 'peugeot',
     'make_model': 'peugeot 2008',
     'model': '2008',
     'odometer': 81617,
     'odometer_in_km': 81617,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2017-04-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 2008 1.2 puretech allure',
     'transmission': 'manual',
     'trim': 'allure',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:31:01Z',
 'fuel_type': 'petrol',
 'id': '5e14c33a-f3c0-5c70-853a-93af437587ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK25722',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 81617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FK25722%27 HTTP/1.1" 200 None
2026-01-28 17:10:42 [auto1.es] INFO: Saving data for FK25722: {'auction_closing_time': 1769704261.0, 'created_time': 1768237319.867942, 'last_price_update_time': 1769620242.780608}
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FK25722') HTTP/1.1" 204 0
2026-01-28 17:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6260c250>
2026-01-28 17:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg saved to cache
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b624ac9d0>
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_ed6c247c0ad45944b6abacc4548359d4.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ed6c247c0ad45944b6abacc4548359d4.jpg saved to cache
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634c6a90>
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg saved to cache
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63649790>
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg saved to cache
2026-01-28 17:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_d8f65c2a3c1831898118293b5598850d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_f4caa89efa90f52581952a13ff687508.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_39445eb8750811371d352e8f2c90daa9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_572156269131e736cc414531709389c1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU19179> (referer: https://www.auto1.com/v1/car-details-view/KU19179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WH17991> (referer: https://www.auto1.com/v1/car-details-view/WH17991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aaf290>
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg saved to cache
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c34c98ca26098388530d01ba305300fa.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629d9310>
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_45857340239d1e8e7d076b52b479e7a5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_45857340239d1e8e7d076b52b479e7a5.jpg saved to cache
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6265f0d0>
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg saved to cache
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62611050>
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg saved to cache
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63542490>
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_d8f65c2a3c1831898118293b5598850d.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_d8f65c2a3c1831898118293b5598850d.jpg saved to cache
2026-01-28 17:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6282d210>
2026-01-28 17:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_f4caa89efa90f52581952a13ff687508.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_f4caa89efa90f52581952a13ff687508.jpg saved to cache
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633bced0>
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_39445eb8750811371d352e8f2c90daa9.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_39445eb8750811371d352e8f2c90daa9.jpg saved to cache
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633bd210>
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_15.jpg HTTP/1.1" 201 0
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_572156269131e736cc414531709389c1.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_572156269131e736cc414531709389c1.jpg saved to cache
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 524a3c1f-ab96-55b2-885d-817dcf19f1c0 with identifier: KU19179
2026-01-28 17:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524a3c1f-ab96-55b2-885d-817dcf19f1c0 with scrape type 2
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 524a3c1f-ab96-55b2-885d-817dcf19f1c0 with scrape type 2
2026-01-28 17:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 524a3c1f-ab96-55b2-885d-817dcf19f1c0, identifier: KU19179
2026-01-28 17:10:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with identifier: WH17991
2026-01-28 17:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with scrape type 2
2026-01-28 17:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with scrape type 2
2026-01-28 17:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9f28c002-157e-59d7-b6b7-6c9a494c17f0, identifier: WH17991
2026-01-28 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_6510a82601c7858e03e5235aba32f2d6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 524a3c1f-ab96-55b2-885d-817dcf19f1c0 with identifier: KU19179
2026-01-28 17:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 524a3c1f-ab96-55b2-885d-817dcf19f1c0 with identifier: KU19179
2026-01-28 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 186614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186614
2026-01-28 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 524a3c1f-ab96-55b2-885d-817dcf19f1c0 spider: auto1.es
2026-01-28 17:10:46 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 524a3c1f-ab96-55b2-885d-817dcf19f1c0 due to rule: high_mileage_for_country.json, error: 186614 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    186614
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:14:19Z',
 'fuel_type': 'diesel',
 'id': '524a3c1f-ab96-55b2-885d-817dcf19f1c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU19179',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 186614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-03',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-01-28 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KU19179%27 HTTP/1.1" 200 None
2026-01-28 17:10:46 [auto1.es] INFO: Saving data for KU19179: {'auction_closing_time': 1769703259.0, 'created_time': 1769065281.608501, 'last_price_update_time': 1769620246.187324}
2026-01-28 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KU19179') HTTP/1.1" 204 0
2026-01-28 17:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with identifier: WH17991
2026-01-28 17:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with identifier: WH17991
2026-01-28 17:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9f28c002-157e-59d7-b6b7-6c9a494c17f0 with identifier: WH17991 to the API
2026-01-28 17:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WH17991>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:45:41Z',
 'fuel_type': 'petrol',
 'id': '9f28c002-157e-59d7-b6b7-6c9a494c17f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH17991',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 61705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-01-28 17:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WH17991%27 HTTP/1.1" 200 None
2026-01-28 17:10:48 [auto1.es] INFO: Saving data for WH17991: {'auction_closing_time': 1769705141.0, 'created_time': 1769421911.407835, 'last_price_update_time': 1769620248.002515}
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WH17991') HTTP/1.1" 204 0
2026-01-28 17:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_33af2938830a75f8660b2666b09297e5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62582950>
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fde%252Fdcde42ddad6b22c1a6b76bfacd4e7a1d%252Fpa%252FSL98070_c34c98ca26098388530d01ba305300fa.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c34c98ca26098388530d01ba305300fa.jpg saved to cache
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de8fc5e7-86a5-52c3-8fa1-908c1763c739
2026-01-28 17:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de8fc5e7-86a5-52c3-8fa1-908c1763c739, skipping ID generation
2026-01-28 17:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de8fc5e7-86a5-52c3-8fa1-908c1763c739 with scrape type 1
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item de8fc5e7-86a5-52c3-8fa1-908c1763c739 from tracking dictionaries
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de8fc5e7-86a5-52c3-8fa1-908c1763c739 sending to next pipeline
2026-01-28 17:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: de8fc5e7-86a5-52c3-8fa1-908c1763c739, identifier: SL98070
2026-01-28 17:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_111ed88925250777ff574b1501de5a83.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG76395> (referer: https://www.auto1.com/v1/car-details-view/BG76395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM42464> (referer: https://www.auto1.com/v1/car-details-view/DM42464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: de8fc5e7-86a5-52c3-8fa1-908c1763c739 with identifier: SL98070
2026-01-28 17:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: de8fc5e7-86a5-52c3-8fa1-908c1763c739 with identifier: SL98070
2026-01-28 17:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller' containing 'traveller'
2026-01-28 17:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: de8fc5e7-86a5-52c3-8fa1-908c1763c739 spider: auto1.es
2026-01-28 17:10:48 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: de8fc5e7-86a5-52c3-8fa1-908c1763c739 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller' containing 'traveller'
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:33:16Z',
 'fuel_type': 'diesel',
 'id': 'de8fc5e7-86a5-52c3-8fa1-908c1763c739',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL98070',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Peugeot',
 'model': 'Traveller',
 'odometer': 187100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_2b0ad15e884771d44be17db056b5f08c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c34c98ca26098388530d01ba305300fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_f4caa89efa90f52581952a13ff687508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_8f9f4321652424a447275a0b397b2b62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_57dafce29bd0d58a0b0be16cc89787d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_5efbbd019c4560d4b9f1903d91426402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_39445eb8750811371d352e8f2c90daa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_c0f809efcad74b7506bd663bf2efa4d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_864b499bf2ba268d6d15c0a74607f3cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_45857340239d1e8e7d076b52b479e7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56057,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_4253451b58a79d16c83864bd9db69328.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ad6963cadbc51a6a083f49cdcdda16da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_fc961d12e98bb2f6429407d7fbe29f9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_ed6c247c0ad45944b6abacc4548359d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_a7dbfa6dd2724daa520141e6bd5489be.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de8fc5e7-86a5-52c3-8fa1-908c1763c739/de8fc5e7-86a5-52c3-8fa1-908c1763c739_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/de/dcde42ddad6b22c1a6b76bfacd4e7a1d/pa/SL98070_d8f65c2a3c1831898118293b5598850d.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-16',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Peugeot Traveller 1.5 Blue-HDi Business L3',
 'transmission': 'manual',
 'trim': 'Business L3',
 'year': 2021}
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SL98070%27 HTTP/1.1" 200 None
2026-01-28 17:10:48 [auto1.es] INFO: Saving data for SL98070: {'created_time': 1769620248.57332, 'last_price_update_time': 1769620248.573331, 'auction_closing_time': 1769704396.0}
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SL98070') HTTP/1.1" 204 0
2026-01-28 17:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344ce90>
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa4%252Fe7a44308b8e5b7d10d571a75b44aed7f%252Fpa%252FDE78584_6510a82601c7858e03e5235aba32f2d6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_6510a82601c7858e03e5235aba32f2d6.jpg saved to cache
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e586504f-ab4b-5e77-9769-2faf151ae106
2026-01-28 17:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e586504f-ab4b-5e77-9769-2faf151ae106, skipping ID generation
2026-01-28 17:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e586504f-ab4b-5e77-9769-2faf151ae106 with scrape type 1
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e586504f-ab4b-5e77-9769-2faf151ae106 from tracking dictionaries
2026-01-28 17:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e586504f-ab4b-5e77-9769-2faf151ae106 sending to next pipeline
2026-01-28 17:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e586504f-ab4b-5e77-9769-2faf151ae106, identifier: DE78584
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6287fa50>
2026-01-28 17:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg saved to cache
2026-01-28 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6344ff90>
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_33af2938830a75f8660b2666b09297e5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_33af2938830a75f8660b2666b09297e5.jpg saved to cache
2026-01-28 17:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e586504f-ab4b-5e77-9769-2faf151ae106 with identifier: DE78584
2026-01-28 17:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e586504f-ab4b-5e77-9769-2faf151ae106 with identifier: DE78584
2026-01-28 17:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e586504f-ab4b-5e77-9769-2faf151ae106 with identifier: DE78584 to the API
2026-01-28 17:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_6510a82601c7858e03e5235aba32f2d6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:29:20Z',
 'fuel_type': 'petrol',
 'id': 'e586504f-ab4b-5e77-9769-2faf151ae106',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE78584',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 64500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188268,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_6510a82601c7858e03e5235aba32f2d6.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_8b52a29d9c84f7b7968fed712fd484c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81388,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_16009d76d8fdeb8202efd67e1110eccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188268,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_21c7928be58d9bc3035f30cdf0107e12.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 169959,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_41d02952fa083cfaa575005d586ab612.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 232680,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_983d4ecaf4d9cc589ef076ba3c6ad606.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188268,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_376a73da6250b14f4732661e70e9e0ef.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276013,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_10440a1e4da9b591db1c30514ffc48f0.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_e2b7cbe4b625f106c2f81cd1ef794ba5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_b4169e56cd80a85373f3bcf43aad9e31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123278,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_38828ab26668aed00327568d8d11838b.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e586504f-ab4b-5e77-9769-2faf151ae106/e586504f-ab4b-5e77-9769-2faf151ae106_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a4/e7a44308b8e5b7d10d571a75b44aed7f/pa/DE78584_0985e4ebc73d8040e51a9bb9f26d5984.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DE78584%27 HTTP/1.1" 200 None
2026-01-28 17:10:50 [auto1.es] INFO: Saving data for DE78584: {'created_time': 1769620250.568482, 'last_price_update_time': 1769620250.568492, 'auction_closing_time': 1769704160.0}
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DE78584') HTTP/1.1" 204 0
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629e40d0>
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg saved to cache
2026-01-28 17:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6270bad0>
2026-01-28 17:10:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc1%252Fffc11ff8085822bd95052b139ef018be%252Fpa%252FFN91376_111ed88925250777ff574b1501de5a83.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_111ed88925250777ff574b1501de5a83.jpg saved to cache
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0dc9471d-3f67-5d00-ac07-228571ec50fc
2026-01-28 17:10:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dc9471d-3f67-5d00-ac07-228571ec50fc, skipping ID generation
2026-01-28 17:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc9471d-3f67-5d00-ac07-228571ec50fc with scrape type 1
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0dc9471d-3f67-5d00-ac07-228571ec50fc from tracking dictionaries
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dc9471d-3f67-5d00-ac07-228571ec50fc sending to next pipeline
2026-01-28 17:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0dc9471d-3f67-5d00-ac07-228571ec50fc, identifier: FN91376
2026-01-28 17:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with identifier: BG76395
2026-01-28 17:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with scrape type 2
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with scrape type 2
2026-01-28 17:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f, identifier: BG76395
2026-01-28 17:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 with identifier: DM42464
2026-01-28 17:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 with scrape type 2
2026-01-28 17:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 with scrape type 2
2026-01-28 17:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9, identifier: DM42464
2026-01-28 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST27973> (referer: https://www.auto1.com/v1/car-details-view/ST27973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF96991> (referer: https://www.auto1.com/v1/car-details-view/EF96991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN22464/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK17847> (referer: https://www.auto1.com/v1/car-details-view/SK17847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JU30162/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0dc9471d-3f67-5d00-ac07-228571ec50fc with identifier: FN91376
2026-01-28 17:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0dc9471d-3f67-5d00-ac07-228571ec50fc with identifier: FN91376
2026-01-28 17:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0dc9471d-3f67-5d00-ac07-228571ec50fc with identifier: FN91376 to the API
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_111ed88925250777ff574b1501de5a83.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:16:10Z',
 'fuel_type': 'petrol',
 'id': '0dc9471d-3f67-5d00-ac07-228571ec50fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN91376',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 72151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_4f8ac5d6db8c96cf8607205745aa5150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171327,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_29e492ab86904da03f0ac74a88fe07c9.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_69a77330f760ca63fb4d17c7c22907f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171327,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_e8579c1c42959b362b29a21465f08f5d.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_1583a32790f38d63a94904530b866f62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183930,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9040df1e1d2fb382b4673c09e4277ee4.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_33af2938830a75f8660b2666b09297e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_3cf0a50e245baa7ccd069a9a83f8ef78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151522,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_0addf3872ea6e614cc6b6ee8e5e8f5b5.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171327,
             'Height': 1530,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_111ed88925250777ff574b1501de5a83.jpg',
             'Width': 2040},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_b31272f0a4b1e3351567f2b5c6336a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc9471d-3f67-5d00-ac07-228571ec50fc/0dc9471d-3f67-5d00-ac07-228571ec50fc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c1/ffc11ff8085822bd95052b139ef018be/pa/FN91376_9e89d38c5f35216a2a1e659e7ecd7965.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-11-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kamiq 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN91376%27 HTTP/1.1" 200 None
2026-01-28 17:10:51 [auto1.es] INFO: Saving data for FN91376: {'created_time': 1769620251.744855, 'last_price_update_time': 1769620251.744866, 'auction_closing_time': 1769703370.0}
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN91376') HTTP/1.1" 204 0
2026-01-28 17:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with identifier: BG76395
2026-01-28 17:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with identifier: BG76395
2026-01-28 17:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f with identifier: BG76395 to the API
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BG76395>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-01-29T16:34:46Z',
 'fuel_type': 'petrol',
 'id': '8e3b7ddd-98ee-5f38-ad5e-57d80fd1c54f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG76395',
 'listing': 'auction',
 'location': 'Palma de Mallorca',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 57128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BG76395%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [auto1.es] INFO: Saving data for BG76395: {'auction_closing_time': 1769704486.0, 'created_time': 1769519822.074331, 'last_price_update_time': 1769620252.063964}
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BG76395') HTTP/1.1" 204 0
2026-01-28 17:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 with identifier: DM42464
2026-01-28 17:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 with identifier: DM42464
2026-01-28 17:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech signature', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 15796, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm42464', 'expiration_date': '2026-01-29t16:04:16z', 'origin_country_code': 'es', 'trim': 'signature', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, vitoria', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'a0c5a10f-784a-56ff-8ee6-38c7830e3aa9', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 15796}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:04:16z',
     'fuel_type': 'petrol',
     'id': 'a0c5a10f-784a-56ff-8ee6-38c7830e3aa9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm42464',
     'listing': 'auction',
     'location': 'es, vitoria',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 15796,
     'odometer_in_km': 15796,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-03-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech signature',
     'transmission': 'manual',
     'trim': 'signature',
     'year': 2019}
2026-01-28 17:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 spider: auto1.es
2026-01-28 17:10:52 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: a0c5a10f-784a-56ff-8ee6-38c7830e3aa9 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': True, 'title': 'peugeot 208 1.2 puretech signature', 'price': 0, 'currency': 'eur', 'make': 'peugeot', 'model': '208', 'transmission': 'manual', 'odometer': 15796, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-24', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm42464', 'expiration_date': '2026-01-29t16:04:16z', 'origin_country_code': 'es', 'trim': 'signature', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 82, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, vitoria', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 110, 'id': 'a0c5a10f-784a-56ff-8ee6-38c7830e3aa9', 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 15796}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'category': None,
     'color': 'red',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 82,
     'expiration_date': '2026-01-29t16:04:16z',
     'fuel_type': 'petrol',
     'id': 'a0c5a10f-784a-56ff-8ee6-38c7830e3aa9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/dm42464',
     'listing': 'auction',
     'location': 'es, vitoria',
     'make': 'peugeot',
     'make_model': 'peugeot 208',
     'model': '208',
     'odometer': 15796,
     'odometer_in_km': 15796,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-03-24',
     'sanitized_make': 'peugeot',
     'seats_number': 5,
     'seller_name': None,
     'title': 'peugeot 208 1.2 puretech signature',
     'transmission': 'manual',
     'trim': 'signature',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-01-29T16:04:16Z',
 'fuel_type': 'petrol',
 'id': 'a0c5a10f-784a-56ff-8ee6-38c7830e3aa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM42464',
 'listing': 'auction',
 'location': 'ES, Vitoria',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 15796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Signature',
 'transmission': 'manual',
 'trim': 'Signature',
 'year': 2019}
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27DM42464%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [auto1.es] INFO: Saving data for DM42464: {'auction_closing_time': 1769702656.0, 'created_time': 1769003017.855541, 'last_price_update_time': 1769620252.299483}
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='DM42464') HTTP/1.1" 204 0
2026-01-28 17:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_97c04a673cc374002197262ea34e7491.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with identifier: ST27973
2026-01-28 17:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with scrape type 2
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with scrape type 2
2026-01-28 17:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 278fb3ba-ea20-58e6-87d2-dd4f3f412796, identifier: ST27973
2026-01-28 17:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b53feddb-5fff-53d3-bcaa-01a3204dc86d with identifier: EF96991
2026-01-28 17:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b53feddb-5fff-53d3-bcaa-01a3204dc86d with scrape type 2
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b53feddb-5fff-53d3-bcaa-01a3204dc86d with scrape type 2
2026-01-28 17:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: b53feddb-5fff-53d3-bcaa-01a3204dc86d, identifier: EF96991
2026-01-28 17:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab712e13-b1fe-5e28-90ad-5189579a4db7 with identifier: SK17847
2026-01-28 17:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab712e13-b1fe-5e28-90ad-5189579a4db7 with scrape type 1
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item ab712e13-b1fe-5e28-90ad-5189579a4db7
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_02e07b58656d96bb0b4b404c463e9810.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_e528a9279e18da70f23ff424721b9cc9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_a5011e0e71a6dd193751683998e98879.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_531c0f67520d4516dd7cc021c2f2290f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_cc63a6f6959669054a98b4972962eded.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_48c7799caa7fb08ccededa116a64898d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_70e16028529b4080e1c5adaa65b680f0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_c017a915f5661c905c8adf32181eb0eb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_2b4a79905d493a74409c3bbcfaa07514.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg already downloaded
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F02%252F5c02975caf0a497e3f20f535f2c2df33%252Fpa%252FSK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg already downloaded
2026-01-28 17:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ab712e13-b1fe-5e28-90ad-5189579a4db7, identifier: SK17847
2026-01-28 17:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with identifier: ST27973
2026-01-28 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with identifier: ST27973
2026-01-28 17:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 278fb3ba-ea20-58e6-87d2-dd4f3f412796 with identifier: ST27973 to the API
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ST27973>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:15:03Z',
 'fuel_type': 'diesel',
 'id': '278fb3ba-ea20-58e6-87d2-dd4f3f412796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST27973',
 'listing': 'auction',
 'location': 'ES, A Coruña',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 90109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence Plus',
 'transmission': 'manual',
 'trim': 'Xcellence Plus',
 'year': 2019}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ST27973%27 HTTP/1.1" 200 None
2026-01-28 17:10:53 [auto1.es] INFO: Saving data for ST27973: {'auction_closing_time': 1769703303.0, 'created_time': 1769518630.25667, 'last_price_update_time': 1769620253.313513}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ST27973') HTTP/1.1" 204 0
2026-01-28 17:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: b53feddb-5fff-53d3-bcaa-01a3204dc86d with identifier: EF96991
2026-01-28 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: b53feddb-5fff-53d3-bcaa-01a3204dc86d with identifier: EF96991
2026-01-28 17:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: b53feddb-5fff-53d3-bcaa-01a3204dc86d with identifier: EF96991 to the API
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF96991>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-01-29T16:31:45Z',
 'fuel_type': 'petrol',
 'id': 'b53feddb-5fff-53d3-bcaa-01a3204dc86d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF96991',
 'listing': 'auction',
 'location': 'ES, Araia',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 121112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Tipo 1.4 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2019}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EF96991%27 HTTP/1.1" 200 None
2026-01-28 17:10:53 [auto1.es] INFO: Saving data for EF96991: {'auction_closing_time': 1769704305.0, 'created_time': 1768653303.815766, 'last_price_update_time': 1769620253.616764}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EF96991') HTTP/1.1" 204 0
2026-01-28 17:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ab712e13-b1fe-5e28-90ad-5189579a4db7 with identifier: SK17847
2026-01-28 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ab712e13-b1fe-5e28-90ad-5189579a4db7 with identifier: SK17847
2026-01-28 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 122369, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk17847', 'expiration_date': '2026-01-29t16:08:47z', 'origin_country_code': 'es', 'trim': 'feel m', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, caldes de malavella (girona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'ab712e13-b1fe-5e28-90ad-5189579a4db7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101874}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92770}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83171}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77063}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99522}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59890}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81085}], 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 122369}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:08:47z',
     'fuel_type': 'petrol',
     'id': 'ab712e13-b1fe-5e28-90ad-5189579a4db7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk17847',
     'listing': 'auction',
     'location': 'es, caldes de malavella (girona)',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 122369,
     'odometer_in_km': 122369,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101874,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95139,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92770,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83171,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77063,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92086,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76005,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 99522,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95850,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59890,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57412,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66518,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57038,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83484,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81085,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-10',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech feel m',
     'transmission': 'manual',
     'trim': 'feel m',
     'year': 2018}
2026-01-28 17:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ab712e13-b1fe-5e28-90ad-5189579a4db7 spider: auto1.es
2026-01-28 17:10:53 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: ab712e13-b1fe-5e28-90ad-5189579a4db7 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech feel m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'manual', 'odometer': 122369, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-10', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk17847', 'expiration_date': '2026-01-29t16:08:47z', 'origin_country_code': 'es', 'trim': 'feel m', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 110, 'doors_number': 5, 'photo_urls': ['https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg', 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg'], 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, caldes de malavella (girona)', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 125, 'id': 'ab712e13-b1fe-5e28-90ad-5189579a4db7', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 101874}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95139}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92770}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83171}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 77063}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 92086}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 76005}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 99522}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 95850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 74903}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59890}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57412}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66518}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57038}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 83484}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 81085}], 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 122369}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 87,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'category': None,
     'color': 'black',
     'currency': 'eur',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 110,
     'expiration_date': '2026-01-29t16:08:47z',
     'fuel_type': 'petrol',
     'id': 'ab712e13-b1fe-5e28-90ad-5189579a4db7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/sk17847',
     'listing': 'auction',
     'location': 'es, caldes de malavella (girona)',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 122369,
     'odometer_in_km': 122369,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photo_urls': ['https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
                    'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg'],
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 101874,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95139,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92770,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83171,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 77063,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 92086,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 76005,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 99522,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 95850,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 74903,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59890,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57412,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66518,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57038,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 83484,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 81085,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2018-10-10',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech feel m',
     'transmission': 'manual',
     'trim': 'feel m',
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-01-29T16:08:47Z',
 'fuel_type': 'petrol',
 'id': 'ab712e13-b1fe-5e28-90ad-5189579a4db7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK17847',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 122369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
                'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02e07b58656d96bb0b4b404c463e9810.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_e528a9279e18da70f23ff424721b9cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_f2c7fc2b2bbdb624bc02cf245375c2ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_a5011e0e71a6dd193751683998e98879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_fbdbc6ae66bbd720e06679ae4f72db58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_531c0f67520d4516dd7cc021c2f2290f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_02b0d6d7a0ef5d6099de00789fd742ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_28b6fe2af0e8030c7ea9d3b9410dafd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_cc63a6f6959669054a98b4972962eded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_48c7799caa7fb08ccededa116a64898d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_dda3abe4fa29574ff02b74977ea9a7a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_70e16028529b4080e1c5adaa65b680f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_c017a915f5661c905c8adf32181eb0eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_0e702b442fe5b33cb3d4f0312a90d9d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_2b4a79905d493a74409c3bbcfaa07514.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab712e13-b1fe-5e28-90ad-5189579a4db7/ab712e13-b1fe-5e28-90ad-5189579a4db7_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/02/5c02975caf0a497e3f20f535f2c2df33/pa/SK17847_bac9b97294df7ebf7969f7b7a62e0a46.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Feel M',
 'transmission': 'manual',
 'trim': 'Feel M',
 'year': 2018}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27SK17847%27 HTTP/1.1" 200 None
2026-01-28 17:10:53 [auto1.es] INFO: Saving data for SK17847: {'created_time': 1769620253.853967, 'last_price_update_time': 1769620253.853979, 'auction_closing_time': 1769702927.0}
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='SK17847') HTTP/1.1" 204 0
2026-01-28 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_702b37814197000a9aa4cb325ad0e84a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY07960> (referer: https://www.auto1.com/v1/car-details-view/RY07960/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633bca10>
2026-01-28 17:10:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg saved to cache
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:10:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634917d0>
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg14%252F5f%252F145ff7f87386e437f33549aeedb67563%252Fpa%252FNN10692_97c04a673cc374002197262ea34e7491.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_97c04a673cc374002197262ea34e7491.jpg saved to cache
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 402543a5-e1f1-52ee-b637-2859df0ac3fc
2026-01-28 17:10:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 402543a5-e1f1-52ee-b637-2859df0ac3fc, skipping ID generation
2026-01-28 17:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 402543a5-e1f1-52ee-b637-2859df0ac3fc with scrape type 1
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 402543a5-e1f1-52ee-b637-2859df0ac3fc from tracking dictionaries
2026-01-28 17:10:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 402543a5-e1f1-52ee-b637-2859df0ac3fc sending to next pipeline
2026-01-28 17:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 402543a5-e1f1-52ee-b637-2859df0ac3fc, identifier: NN10692
2026-01-28 17:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 402543a5-e1f1-52ee-b637-2859df0ac3fc with identifier: NN10692
2026-01-28 17:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 402543a5-e1f1-52ee-b637-2859df0ac3fc with identifier: NN10692
2026-01-28 17:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 402543a5-e1f1-52ee-b637-2859df0ac3fc with identifier: NN10692 to the API
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_97c04a673cc374002197262ea34e7491.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 158,
 'expiration_date': '2026-01-29T16:53:23Z',
 'fuel_type': 'petrol',
 'id': '402543a5-e1f1-52ee-b637-2859df0ac3fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN10692',
 'listing': 'auction',
 'location': 'ES, Palma de Mallorca',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 35176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_01fff1675732872f7b6a60bf0e55a823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_3f1e6eef783b97a65d05c7aa5cc847dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_16a18a5d8cda9f49ec4433fb4cf65503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2529913,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_97c04a673cc374002197262ea34e7491.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_e7e29b746f02f6f6ee11b8e737e1ccc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5a5282b79aeabc79a384280252d16715.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_b29d7fd29583a81984c4256767c78a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_7d908d14306117918338b7a9de11357b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_d2c823e6fd52f75fa0f5a9ec7fbcef26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_5dc48211d81a7cb4eb3c5e5cadc7fbd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_450f8f3aeddac02851872c73e5039f07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_895a40df6fce87feec38110c4896da53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_41c158a4a49c8cd56d748e2cf02cd414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_701b4f2dbd88eae79fb2437b6d5c24f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_2d5a38dcf9481d55b29ba20240cd41e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_402543a5-e1f1-52ee-b637-2859df0ac3fc/402543a5-e1f1-52ee-b637-2859df0ac3fc_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img14/5f/145ff7f87386e437f33549aeedb67563/pa/NN10692_572156269131e736cc414531709389c1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2023}
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27NN10692%27 HTTP/1.1" 200 None
2026-01-28 17:10:54 [auto1.es] INFO: Saving data for NN10692: {'created_time': 1769620254.929805, 'last_price_update_time': 1769620254.929817, 'auction_closing_time': 1769705603.0}
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='NN10692') HTTP/1.1" 204 0
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62690390>
2026-01-28 17:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_063150f48db355214d6a90e74ed3ffa1.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg saved to cache
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a112d0>
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_702b37814197000a9aa4cb325ad0e84a.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_702b37814197000a9aa4cb325ad0e84a.jpg saved to cache
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62621310>
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_aa37c76e297ad72f4b61c3499a98d899.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg saved to cache
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62693210>
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg saved to cache
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbcf5a6d-c043-5042-80ed-ec8cf09627cc with identifier: RY07960
2026-01-28 17:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbcf5a6d-c043-5042-80ed-ec8cf09627cc with scrape type 2
2026-01-28 17:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbcf5a6d-c043-5042-80ed-ec8cf09627cc with scrape type 2
2026-01-28 17:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: fbcf5a6d-c043-5042-80ed-ec8cf09627cc, identifier: RY07960
2026-01-28 17:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: fbcf5a6d-c043-5042-80ed-ec8cf09627cc with identifier: RY07960
2026-01-28 17:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: fbcf5a6d-c043-5042-80ed-ec8cf09627cc with identifier: RY07960
2026-01-28 17:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: fbcf5a6d-c043-5042-80ed-ec8cf09627cc with identifier: RY07960 to the API
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY07960>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'engine_horse_power': 450,
 'expiration_date': '2026-01-29T16:44:21Z',
 'fuel_type': 'petrol',
 'id': 'fbcf5a6d-c043-5042-80ed-ec8cf09627cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY07960',
 'listing': 'auction',
 'location': 'ES, Campo Real',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 87514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27RY07960%27 HTTP/1.1" 200 None
2026-01-28 17:10:56 [auto1.es] INFO: Saving data for RY07960: {'auction_closing_time': 1769705061.0, 'created_time': 1768298834.813855, 'last_price_update_time': 1769620256.332374}
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='RY07960') HTTP/1.1" 204 0
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5fe54f29e6985e778faee857989b7fb2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX59239> (referer: https://www.auto1.com/v1/car-details-view/FX59239/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN28666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ82790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML12744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM19053/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b627b2750>
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg saved to cache
2026-01-28 17:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_10ea577fdf716d4ade945738239a22c5.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62966a90>
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5fe54f29e6985e778faee857989b7fb2.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5fe54f29e6985e778faee857989b7fb2.jpg saved to cache
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce65c68e-315d-5d7e-90a8-b754598e35a5 with identifier: FX59239
2026-01-28 17:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce65c68e-315d-5d7e-90a8-b754598e35a5 with scrape type 1
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 15 photos for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg not downloaded yet
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634e80d0>
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_18eaca7f6af3427707b907ddaedabb2b.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg saved to cache
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_3272bd4d1392686a321a61327b5f570c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3272bd4d1392686a321a61327b5f570c.jpg not downloaded yet
2026-01-28 17:10:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH57940> (referer: https://www.auto1.com/v1/car-details-view/EH57940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_422003e384f2c686d8b9907978d6b23f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_422003e384f2c686d8b9907978d6b23f.jpg not downloaded yet
2026-01-28 17:10:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a8e6d0>
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252Fb7%252Fa7b7b447edb5c7f4bf3114b9e2ea89be%252Fpa%252FXL84639_869bb7293f0bf79361022d7cea5176b6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg saved to cache
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 694150a8-fc9f-5b61-8f90-8346db47bd35
2026-01-28 17:10:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 694150a8-fc9f-5b61-8f90-8346db47bd35, skipping ID generation
2026-01-28 17:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694150a8-fc9f-5b61-8f90-8346db47bd35 with scrape type 1
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 694150a8-fc9f-5b61-8f90-8346db47bd35 from tracking dictionaries
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 694150a8-fc9f-5b61-8f90-8346db47bd35 sending to next pipeline
2026-01-28 17:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 694150a8-fc9f-5b61-8f90-8346db47bd35, identifier: XL84639
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636d0190>
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_10ea577fdf716d4ade945738239a22c5.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_10ea577fdf716d4ade945738239a22c5.jpg saved to cache
2026-01-28 17:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629ce4d0>
2026-01-28 17:10:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg saved to cache
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_7bbacb30ace58ccf0bd00881be027c35.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_7bbacb30ace58ccf0bd00881be027c35.jpg not downloaded yet
2026-01-28 17:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 694150a8-fc9f-5b61-8f90-8346db47bd35 with identifier: XL84639
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 694150a8-fc9f-5b61-8f90-8346db47bd35 with identifier: XL84639
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech shine m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'automatic', 'odometer': 97585, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl84639', 'expiration_date': '2026-01-29t16:38:21z', 'origin_country_code': 'es', 'trim': 'shine m', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, oiartzun', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 162, 'id': '694150a8-fc9f-5b61-8f90-8346db47bd35', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63299}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2187284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66468}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59905}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89353}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71780}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2289505}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65326}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54720}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86171}], 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 97585}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 162,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:38:21z',
     'fuel_type': 'petrol',
     'id': '694150a8-fc9f-5b61-8f90-8346db47bd35',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl84639',
     'listing': 'auction',
     'location': 'es, oiartzun',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 97585,
     'odometer_in_km': 97585,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79192,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73297,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63299,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2187284,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66468,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59905,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89353,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71780,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2289505,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56068,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65326,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54051,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57618,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54720,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86171,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-02',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech shine m',
     'transmission': 'automatic',
     'trim': 'shine m',
     'year': 2019}
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 694150a8-fc9f-5b61-8f90-8346db47bd35 spider: auto1.es
2026-01-28 17:10:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 694150a8-fc9f-5b61-8f90-8346db47bd35 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gray', 'original_photo_count': 16, 'seller_name': None, 'price_includes_vat': True, 'title': 'citroen berlingo 1.2 puretech shine m', 'price': 0, 'currency': 'eur', 'make': 'citroen', 'model': 'berlingo', 'transmission': 'automatic', 'odometer': 97585, 'odometer_reading_unit': 'km', 'registration_date': '2019-12-02', 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl84639', 'expiration_date': '2026-01-29t16:38:21z', 'origin_country_code': 'es', 'trim': 'shine m', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'engine_horse_power': 131, 'doors_number': 5, 'is_vat_deductible': False, 'is_vat_included': True, 'engine': '1.2l', 'location': 'es, oiartzun', 'category': None, 'seats_number': 5, 'emission_standard': 'euro 6', 'c_o_2_emission_value': 162, 'id': '694150a8-fc9f-5b61-8f90-8346db47bd35', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 79192}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 73297}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 63299}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2187284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 66468}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 59905}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 89353}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 71780}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg', 'Width': 2048, 'Height': 1536, 'Extension': 'jpg', 'FileSizeInBytes': 2289505}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 56068}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 65326}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54051}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 57618}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 54720}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg', 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg', 'Width': 800, 'Height': 600, 'Extension': 'jpg', 'FileSizeInBytes': 86171}], 'current_year_diff': 7, 'age_in_months': 73, 'make_model': 'citroen berlingo', 'sanitized_make': 'citroen', 'odometer_in_km': 97585}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 73,
     'auction_title': '',
     'c_o_2_emission_value': 162,
     'category': None,
     'color': 'gray',
     'currency': 'eur',
     'current_year_diff': 7,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.2l',
     'engine_horse_power': 131,
     'expiration_date': '2026-01-29t16:38:21z',
     'fuel_type': 'petrol',
     'id': '694150a8-fc9f-5b61-8f90-8346db47bd35',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/xl84639',
     'listing': 'auction',
     'location': 'es, oiartzun',
     'make': 'citroen',
     'make_model': 'citroen berlingo',
     'model': 'berlingo',
     'odometer': 97585,
     'odometer_in_km': 97585,
     'odometer_reading_unit': 'km',
     'origin_country_code': 'es',
     'original_photo_count': 16,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 79192,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 73297,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65982,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 63299,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2187284,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 66468,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 59905,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 89353,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 71780,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 2289505,
                 'Height': 1536,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg',
                 'Width': 2048},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 56068,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 65326,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54051,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 57618,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 54720,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg',
                 'Width': 800},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 86171,
                 'Height': 600,
                 'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg',
                 'Width': 800}],
     'price': 0,
     'price_includes_vat': True,
     'registration_date': '2019-12-02',
     'sanitized_make': 'citroen',
     'seats_number': 5,
     'seller_name': None,
     'title': 'citroen berlingo 1.2 puretech shine m',
     'transmission': 'automatic',
     'trim': 'shine m',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-01-29T16:38:21Z',
 'fuel_type': 'petrol',
 'id': '694150a8-fc9f-5b61-8f90-8346db47bd35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL84639',
 'listing': 'auction',
 'location': 'ES, Oiartzun',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 97585,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_b109d420a9b79d46c239cb17f85c7f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_18eaca7f6af3427707b907ddaedabb2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_869bb7293f0bf79361022d7cea5176b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_bb9eab2bee57c9fbc78ec7d6fad2eba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2187284,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_64ee57f74697da586be8c724486d44a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_aa37c76e297ad72f4b61c3499a98d899.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_063150f48db355214d6a90e74ed3ffa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_986ee77047da129ae36c21b917c83f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_3ff6ca6f888ef4a3b591f7eb4895d2d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2289505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_62fa32b9bbe961821ed6861da526e98a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_2bc72f19c98085b0d268fa4d1487012c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_fe78d01c05915c15c02a49c51a00d6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_a59b9def04df52a814bf5a644d060b08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_96b3adf21e146a21aabddc21a8d07648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f451702c4f07006bee649bc7233b3c22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_694150a8-fc9f-5b61-8f90-8346db47bd35/694150a8-fc9f-5b61-8f90-8346db47bd35_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/b7/a7b7b447edb5c7f4bf3114b9e2ea89be/pa/XL84639_f48049c0a154407d3589cde080fa9f9b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Shine M',
 'transmission': 'automatic',
 'trim': 'Shine M',
 'year': 2019}
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XL84639%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [auto1.es] INFO: Saving data for XL84639: {'created_time': 1769620258.339573, 'last_price_update_time': 1769620258.339586, 'auction_closing_time': 1769704701.0}
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XL84639') HTTP/1.1" 204 0
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5b7857d91073b5e6e71d846cee6151f6.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_cb533fa9198f9966d4694d023f808ab3.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg not downloaded yet
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JU30162> (referer: https://www.auto1.com/v1/car-details-view/JU30162/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PZ78942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP36756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN22464> (referer: https://www.auto1.com/v1/car-details-view/FN22464/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BX26344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KY51908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fcd21f-3ca3-58bb-83d1-948451c2581f with identifier: EH57940
2026-01-28 17:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fcd21f-3ca3-58bb-83d1-948451c2581f with scrape type 2
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fcd21f-3ca3-58bb-83d1-948451c2581f with scrape type 2
2026-01-28 17:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 15fcd21f-3ca3-58bb-83d1-948451c2581f, identifier: EH57940
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 15fcd21f-3ca3-58bb-83d1-948451c2581f with identifier: EH57940
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 15fcd21f-3ca3-58bb-83d1-948451c2581f with identifier: EH57940
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 196998 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196998
2026-01-28 17:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 15fcd21f-3ca3-58bb-83d1-948451c2581f spider: auto1.es
2026-01-28 17:10:58 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 15fcd21f-3ca3-58bb-83d1-948451c2581f due to rule: high_mileage_for_country.json, error: 196998 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    196998
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:38:15Z',
 'fuel_type': 'diesel',
 'id': '15fcd21f-3ca3-58bb-83d1-948451c2581f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH57940',
 'listing': 'auction',
 'location': 'ES, Caldes de Malavella (Girona)',
 'make': 'BMW',
 'model': '5er',
 'odometer': 196998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27EH57940%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [auto1.es] INFO: Saving data for EH57940: {'auction_closing_time': 1769704695.0, 'created_time': 1769519475.823239, 'last_price_update_time': 1769620258.719103}
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='EH57940') HTTP/1.1" 204 0
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg not downloaded yet
2026-01-28 17:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3272bd4d1392686a321a61327b5f570c.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_849be41c65cc17a9c50c6b886ef13574.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_849be41c65cc17a9c50c6b886ef13574.jpg not downloaded yet
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633be210>
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5b7857d91073b5e6e71d846cee6151f6.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5b7857d91073b5e6e71d846cee6151f6.jpg saved to cache
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62aee210>
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_cb533fa9198f9966d4694d023f808ab3.jpg') HTTP/1.1" 204 0
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_cb533fa9198f9966d4694d023f808ab3.jpg saved to cache
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76ca806c-3f6e-58ad-8ec0-90e173780931 with identifier: JU30162
2026-01-28 17:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76ca806c-3f6e-58ad-8ec0-90e173780931 with scrape type 2
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76ca806c-3f6e-58ad-8ec0-90e173780931 with scrape type 2
2026-01-28 17:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 76ca806c-3f6e-58ad-8ec0-90e173780931, identifier: JU30162
2026-01-28 17:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e633c73-6237-5708-9799-f3ee43552601 with identifier: FN22464
2026-01-28 17:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e633c73-6237-5708-9799-f3ee43552601 with scrape type 2
2026-01-28 17:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e633c73-6237-5708-9799-f3ee43552601 with scrape type 2
2026-01-28 17:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 9e633c73-6237-5708-9799-f3ee43552601, identifier: FN22464
2026-01-28 17:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 76ca806c-3f6e-58ad-8ec0-90e173780931 with identifier: JU30162
2026-01-28 17:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 76ca806c-3f6e-58ad-8ec0-90e173780931 with identifier: JU30162
2026-01-28 17:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 76ca806c-3f6e-58ad-8ec0-90e173780931 with identifier: JU30162 to the API
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JU30162>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:33:47Z',
 'fuel_type': 'diesel',
 'id': '76ca806c-3f6e-58ad-8ec0-90e173780931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU30162',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'BMW',
 'model': '4er',
 'odometer': 121774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 4er 418d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27JU30162%27 HTTP/1.1" 200 None
2026-01-28 17:10:59 [auto1.es] INFO: Saving data for JU30162: {'auction_closing_time': 1769704427.0, 'created_time': 1769519109.145212, 'last_price_update_time': 1769620259.795802}
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='JU30162') HTTP/1.1" 204 0
2026-01-28 17:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 9e633c73-6237-5708-9799-f3ee43552601 with identifier: FN22464
2026-01-28 17:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 9e633c73-6237-5708-9799-f3ee43552601 with identifier: FN22464
2026-01-28 17:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 9e633c73-6237-5708-9799-f3ee43552601 with identifier: FN22464 to the API
2026-01-28 17:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN22464>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-01-29T16:45:24Z',
 'fuel_type': 'petrol',
 'id': '9e633c73-6237-5708-9799-f3ee43552601',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN22464',
 'listing': 'auction',
 'location': 'ES, La Roda de Andalucía',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 107979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Tecno 2WD',
 'transmission': 'manual',
 'trim': 'Tecno 2WD',
 'year': 2019}
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN22464%27 HTTP/1.1" 200 None
2026-01-28 17:11:00 [auto1.es] INFO: Saving data for FN22464: {'auction_closing_time': 1769705124.0, 'created_time': 1769421833.815753, 'last_price_update_time': 1769620260.174889}
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN22464') HTTP/1.1" 204 0
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_7bbacb30ace58ccf0bd00881be027c35.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_5f83edaa180b9608da734a12f1f72477.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5f83edaa180b9608da734a12f1f72477.jpg not downloaded yet
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_422003e384f2c686d8b9907978d6b23f.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL56858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b63362050>
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_3272bd4d1392686a321a61327b5f570c.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3272bd4d1392686a321a61327b5f570c.jpg saved to cache
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg not downloaded yet
2026-01-28 17:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WS16949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg not downloaded yet
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62729810>
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_7bbacb30ace58ccf0bd00881be027c35.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_7bbacb30ace58ccf0bd00881be027c35.jpg saved to cache
2026-01-28 17:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62690550>
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg saved to cache
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6336a710>
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_422003e384f2c686d8b9907978d6b23f.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_422003e384f2c686d8b9907978d6b23f.jpg saved to cache
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_817b9785a22448354e1fba25cf374bd9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_817b9785a22448354e1fba25cf374bd9.jpg not downloaded yet
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5f83edaa180b9608da734a12f1f72477.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM67211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC75977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ95887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX86419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636bd2d0>
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg saved to cache
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_a8c73e80879beea40f3de7857690246d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a8c73e80879beea40f3de7857690246d.jpg not downloaded yet
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML12744> (referer: https://www.auto1.com/v1/car-details-view/ML12744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg not downloaded yet
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM19053> (referer: https://www.auto1.com/v1/car-details-view/BM19053/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b633ae450>
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_5f83edaa180b9608da734a12f1f72477.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5f83edaa180b9608da734a12f1f72477.jpg saved to cache
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_817b9785a22448354e1fba25cf374bd9.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg not downloaded yet
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b628e4910>
2026-01-28 17:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_8.jpg HTTP/1.1" 201 0
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg saved to cache
2026-01-28 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6153e73-a532-57a0-b430-de5b504146f4 with identifier: ML12744
2026-01-28 17:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6153e73-a532-57a0-b430-de5b504146f4 with scrape type 2
2026-01-28 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6153e73-a532-57a0-b430-de5b504146f4 with scrape type 2
2026-01-28 17:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: d6153e73-a532-57a0-b430-de5b504146f4, identifier: ML12744
2026-01-28 17:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d661ff1-1fa4-521f-858a-d381cdb42ade with identifier: BM19053
2026-01-28 17:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d661ff1-1fa4-521f-858a-d381cdb42ade with scrape type 2
2026-01-28 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d661ff1-1fa4-521f-858a-d381cdb42ade with scrape type 2
2026-01-28 17:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8d661ff1-1fa4-521f-858a-d381cdb42ade, identifier: BM19053
2026-01-28 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_849be41c65cc17a9c50c6b886ef13574.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg not downloaded yet
2026-01-28 17:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: d6153e73-a532-57a0-b430-de5b504146f4 with identifier: ML12744
2026-01-28 17:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: d6153e73-a532-57a0-b430-de5b504146f4 with identifier: ML12744
2026-01-28 17:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: d6153e73-a532-57a0-b430-de5b504146f4 with identifier: ML12744 to the API
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ML12744>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:28:48Z',
 'fuel_type': 'petrol',
 'id': 'd6153e73-a532-57a0-b430-de5b504146f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML12744',
 'listing': 'auction',
 'location': 'ES, Alcalá de Henares, Madrid',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 60173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ML12744%27 HTTP/1.1" 200 None
2026-01-28 17:11:02 [auto1.es] INFO: Saving data for ML12744: {'auction_closing_time': 1769704128.0, 'created_time': 1767619866.796224, 'last_price_update_time': 1769620262.601637}
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ML12744') HTTP/1.1" 204 0
2026-01-28 17:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8d661ff1-1fa4-521f-858a-d381cdb42ade with identifier: BM19053
2026-01-28 17:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8d661ff1-1fa4-521f-858a-d381cdb42ade with identifier: BM19053
2026-01-28 17:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 8d661ff1-1fa4-521f-858a-d381cdb42ade with identifier: BM19053 to the API
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BM19053>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:33:33Z',
 'fuel_type': 'petrol',
 'id': '8d661ff1-1fa4-521f-858a-d381cdb42ade',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM19053',
 'listing': 'auction',
 'location': 'ES, Cuenca',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 131334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BM19053%27 HTTP/1.1" 200 None
2026-01-28 17:11:02 [auto1.es] INFO: Saving data for BM19053: {'auction_closing_time': 1769704413.0, 'created_time': 1769421766.914364, 'last_price_update_time': 1769620262.911959}
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BM19053') HTTP/1.1" 204 0
2026-01-28 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5126b6a3929638cef7992f3197987b98.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a8c73e80879beea40f3de7857690246d.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b635d4150>
2026-01-28 17:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_9.jpg HTTP/1.1" 201 0
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg saved to cache
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6290cb50>
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg saved to cache
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62737b90>
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_10.jpg HTTP/1.1" 201 0
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_817b9785a22448354e1fba25cf374bd9.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_817b9785a22448354e1fba25cf374bd9.jpg saved to cache
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN28666> (referer: https://www.auto1.com/v1/car-details-view/FN28666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ82790> (referer: https://www.auto1.com/v1/car-details-view/XJ82790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b623274d0>
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_849be41c65cc17a9c50c6b886ef13574.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_849be41c65cc17a9c50c6b886ef13574.jpg saved to cache
2026-01-28 17:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b629b3850>
2026-01-28 17:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg58%252F95%252F58956f1231a744d1f090a0633f5a1a9d%252Fpa%252FUG23726_5126b6a3929638cef7992f3197987b98.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5126b6a3929638cef7992f3197987b98.jpg saved to cache
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3
2026-01-28 17:11:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3, skipping ID generation
2026-01-28 17:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with scrape type 1
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 from tracking dictionaries
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 sending to next pipeline
2026-01-28 17:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3, identifier: UG23726
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b634d2650>
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_11.jpg HTTP/1.1" 201 0
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_a8c73e80879beea40f3de7857690246d.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a8c73e80879beea40f3de7857690246d.jpg saved to cache
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with identifier: UG23726
2026-01-28 17:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with identifier: UG23726
2026-01-28 17:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3 with identifier: UG23726 to the API
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5126b6a3929638cef7992f3197987b98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 230,
 'expiration_date': '2026-01-29T16:02:26Z',
 'fuel_type': 'hybrid',
 'id': '0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG23726',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 30489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5b7857d91073b5e6e71d846cee6151f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_cb533fa9198f9966d4694d023f808ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_b287248cb9e59c7f8bbb4d6933e5f060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_9884531b409f6b987cdfc5aa987f738e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_10ea577fdf716d4ade945738239a22c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201211,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5126b6a3929638cef7992f3197987b98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_112fdb5b0c1c9e8f95d5a88999829379.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_af8efee03ed5c7a2bc2659452f91cfec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81395,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_5fe54f29e6985e778faee857989b7fb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_303b73a8c59e0d9c102ea71a8a12f61c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61465,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_702b37814197000a9aa4cb325ad0e84a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_f04db2e30779771697e39ca724ad5deb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_4acf85b4a48627f372728921941eacfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_0146b826257cfee361d1725bbcb93ce9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_d9c3e14cf79233e9733cf4a8edd69491.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3/0f7dd3a8-8182-5f7d-a2a2-1c9e6308c4d3_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img58/95/58956f1231a744d1f090a0633f5a1a9d/pa/UG23726_8464d3620e8614da9e4f1166424250d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Tecno 2WD',
 'transmission': 'automatic',
 'trim': 'Tecno 2WD',
 'year': 2021}
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UG23726%27 HTTP/1.1" 200 None
2026-01-28 17:11:04 [auto1.es] INFO: Saving data for UG23726: {'created_time': 1769620264.889652, 'last_price_update_time': 1769620264.889663, 'auction_closing_time': 1769702546.0}
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UG23726') HTTP/1.1" 204 0
2026-01-28 17:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2ca786-9b65-5c94-b40e-a584ef891c28 with identifier: FN28666
2026-01-28 17:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2ca786-9b65-5c94-b40e-a584ef891c28 with scrape type 2
2026-01-28 17:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e2ca786-9b65-5c94-b40e-a584ef891c28 with scrape type 2
2026-01-28 17:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 8e2ca786-9b65-5c94-b40e-a584ef891c28, identifier: FN28666
2026-01-28 17:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a69afa1-3920-53c1-93d3-a4a494ffb7e8 with identifier: XJ82790
2026-01-28 17:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a69afa1-3920-53c1-93d3-a4a494ffb7e8 with scrape type 1
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 3a69afa1-3920-53c1-93d3-a4a494ffb7e8
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_02f66384f497fbfa59d3e5d33adf84bb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_02f66384f497fbfa59d3e5d33adf84bb.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_20b47db2cb978075b96d59ea47312ee4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_20b47db2cb978075b96d59ea47312ee4.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_d9b57b461d4a458651652e300233b71f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d9b57b461d4a458651652e300233b71f.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_95bfe23e5620ab15beac25e2bab1782d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_95bfe23e5620ab15beac25e2bab1782d.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_ff75e54eb8bca661f176221a794e3e73.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_ff75e54eb8bca661f176221a794e3e73.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_e971de7a960f898cfc862b6e7b4afddd.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_e971de7a960f898cfc862b6e7b4afddd.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_7d38f9c6295418ddfc83aa7a161117fe.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_7d38f9c6295418ddfc83aa7a161117fe.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_234725b0f18ebdc98bc96e50637822be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_234725b0f18ebdc98bc96e50637822be.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_2469afbf9e375eb0d1cecf18d4fef370.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_2469afbf9e375eb0d1cecf18d4fef370.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_d77e4d3691a40ea91fb4fab7b4caaa8d.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d77e4d3691a40ea91fb4fab7b4caaa8d.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_72df819dcbb55a1b3376cc2a9f853e25.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_72df819dcbb55a1b3376cc2a9f853e25.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_b243e478cd1b44450fc1b78c0ea796da.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_b243e478cd1b44450fc1b78c0ea796da.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_792dcd499c7bbce9ac1b1c5daf4b5241.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_792dcd499c7bbce9ac1b1c5daf4b5241.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_cdee51593064293d5ebb64d3537c49f2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_cdee51593064293d5ebb64d3537c49f2.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_501a5058a4ef1fe98b29000e70d44f6a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_501a5058a4ef1fe98b29000e70d44f6a.jpg already downloaded
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252F12%252F2612475bc2ef73fb7aaff49d81d80fa3%252Fpa%252FXJ82790_96f532b6f77dd185355d99ced759a7c3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_96f532b6f77dd185355d99ced759a7c3.jpg already downloaded
2026-01-28 17:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 3a69afa1-3920-53c1-93d3-a4a494ffb7e8, identifier: XJ82790
2026-01-28 17:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 8e2ca786-9b65-5c94-b40e-a584ef891c28 with identifier: FN28666
2026-01-28 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 8e2ca786-9b65-5c94-b40e-a584ef891c28 with identifier: FN28666
2026-01-28 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 8e2ca786-9b65-5c94-b40e-a584ef891c28 spider: auto1.es
2026-01-28 17:11:05 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 8e2ca786-9b65-5c94-b40e-a584ef891c28 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:51:17Z',
 'fuel_type': 'diesel',
 'id': '8e2ca786-9b65-5c94-b40e-a584ef891c28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN28666',
 'listing': 'auction',
 'location': 'ES, Granyanella',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 125942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-16',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Active L2',
 'transmission': 'manual',
 'trim': 'Active L2',
 'year': 2018}
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FN28666%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [auto1.es] INFO: Saving data for FN28666: {'auction_closing_time': 1769705477.0, 'created_time': 1768410050.0437, 'last_price_update_time': 1769620265.634454}
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FN28666') HTTP/1.1" 204 0
2026-01-28 17:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 3a69afa1-3920-53c1-93d3-a4a494ffb7e8 with identifier: XJ82790
2026-01-28 17:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 3a69afa1-3920-53c1-93d3-a4a494ffb7e8 with identifier: XJ82790
2026-01-28 17:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 3a69afa1-3920-53c1-93d3-a4a494ffb7e8 with identifier: XJ82790 to the API
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XJ82790>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:34:27Z',
 'fuel_type': 'petrol',
 'id': '3a69afa1-3920-53c1-93d3-a4a494ffb7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ82790',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 62076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_02f66384f497fbfa59d3e5d33adf84bb.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_20b47db2cb978075b96d59ea47312ee4.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d9b57b461d4a458651652e300233b71f.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_95bfe23e5620ab15beac25e2bab1782d.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_ff75e54eb8bca661f176221a794e3e73.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_e971de7a960f898cfc862b6e7b4afddd.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_7d38f9c6295418ddfc83aa7a161117fe.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_234725b0f18ebdc98bc96e50637822be.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_2469afbf9e375eb0d1cecf18d4fef370.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d77e4d3691a40ea91fb4fab7b4caaa8d.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_72df819dcbb55a1b3376cc2a9f853e25.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_b243e478cd1b44450fc1b78c0ea796da.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_792dcd499c7bbce9ac1b1c5daf4b5241.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_cdee51593064293d5ebb64d3537c49f2.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_501a5058a4ef1fe98b29000e70d44f6a.jpg',
                'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_96f532b6f77dd185355d99ced759a7c3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_02f66384f497fbfa59d3e5d33adf84bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_20b47db2cb978075b96d59ea47312ee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d9b57b461d4a458651652e300233b71f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_95bfe23e5620ab15beac25e2bab1782d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_ff75e54eb8bca661f176221a794e3e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_e971de7a960f898cfc862b6e7b4afddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_7d38f9c6295418ddfc83aa7a161117fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_234725b0f18ebdc98bc96e50637822be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_2469afbf9e375eb0d1cecf18d4fef370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_d77e4d3691a40ea91fb4fab7b4caaa8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_72df819dcbb55a1b3376cc2a9f853e25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_b243e478cd1b44450fc1b78c0ea796da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_792dcd499c7bbce9ac1b1c5daf4b5241.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_cdee51593064293d5ebb64d3537c49f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62138,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_501a5058a4ef1fe98b29000e70d44f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69afa1-3920-53c1-93d3-a4a494ffb7e8/3a69afa1-3920-53c1-93d3-a4a494ffb7e8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img26/12/2612475bc2ef73fb7aaff49d81d80fa3/pa/XJ82790_96f532b6f77dd185355d99ced759a7c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Advance',
 'transmission': 'automatic',
 'trim': 'Advance',
 'year': 2022}
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27XJ82790%27 HTTP/1.1" 200 None
2026-01-28 17:11:05 [auto1.es] INFO: Saving data for XJ82790: {'created_time': 1769620265.961635, 'last_price_update_time': 1769620265.96165, 'auction_closing_time': 1769704467.0}
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='XJ82790') HTTP/1.1" 204 0
2026-01-28 17:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg> (referer: https://www.auto1.com/)
2026-01-28 17:11:05 [scrapy.extensions.logstats] INFO: Crawled 1332 pages (at 72 pages/min), scraped 365 items (at 25 items/min)
2026-01-28 17:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL56858> (referer: https://www.auto1.com/v1/car-details-view/ZL56858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD94145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b636992d0>
2026-01-28 17:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_13.jpg HTTP/1.1" 201 0
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg saved to cache
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b6347b010>
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_12.jpg HTTP/1.1" 201 0
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg saved to cache
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f4b62a60490>
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 17:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_14.jpg HTTP/1.1" 201 0
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.es',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F1a%252F891adbe82b402e64b5a71733e2255462%252Fpa%252FFX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg') HTTP/1.1" 204 0
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg saved to cache
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ce65c68e-315d-5d7e-90a8-b754598e35a5
2026-01-28 17:11:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce65c68e-315d-5d7e-90a8-b754598e35a5, skipping ID generation
2026-01-28 17:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce65c68e-315d-5d7e-90a8-b754598e35a5 with scrape type 1
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ce65c68e-315d-5d7e-90a8-b754598e35a5 from tracking dictionaries
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce65c68e-315d-5d7e-90a8-b754598e35a5 sending to next pipeline
2026-01-28 17:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: ce65c68e-315d-5d7e-90a8-b754598e35a5, identifier: FX59239
2026-01-28 17:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cf0badd-d420-570a-9f4b-40b69b46509c with identifier: ZL56858
2026-01-28 17:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cf0badd-d420-570a-9f4b-40b69b46509c with scrape type 1
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 18 photos for item 7cf0badd-d420-570a-9f4b-40b69b46509c
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_cb8bbd5b8864afff6f2950aed99a02c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_cb8bbd5b8864afff6f2950aed99a02c0.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_8007d33f6f8470f6fc004255265c1ff3.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8007d33f6f8470f6fc004255265c1ff3.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_76f849556138d87edae4b17a836af5b4.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_76f849556138d87edae4b17a836af5b4.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_03c317810e06852edb86aeef9250b4ed.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_03c317810e06852edb86aeef9250b4ed.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_f3f556a16e204b9347b136c9e12c31be.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f3f556a16e204b9347b136c9e12c31be.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_3a3eba16521232a8229286a530974eb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3a3eba16521232a8229286a530974eb9.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_74b835384a3ffdae9014217d79029afb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_74b835384a3ffdae9014217d79029afb.jpg already downloaded
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_115dfe4a8b60bd51bea07f7ac074c654.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_115dfe4a8b60bd51bea07f7ac074c654.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_250545f8428c52092a3be81c91038cb9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_250545f8428c52092a3be81c91038cb9.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_b689ea54b9ff9bf9ce41f3ec4eaabb96.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_b689ea54b9ff9bf9ce41f3ec4eaabb96.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_f9ca36f79ad0a094d3fdb4415f484276.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f9ca36f79ad0a094d3fdb4415f484276.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_f2b3e15bfcc6c7dad674376b0b1bef86.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f2b3e15bfcc6c7dad674376b0b1bef86.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_13645dd78a57efb784336ba566c71b5b.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_13645dd78a57efb784336ba566c71b5b.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_3d3b4e2d403861de5927a1582e27eb6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3d3b4e2d403861de5927a1582e27eb6e.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_8fd9969b7155b23a96f329dd66d5a29c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8fd9969b7155b23a96f329dd66d5a29c.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_ab5b436563a455fbe20ef7dfc6c7d4d5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_ab5b436563a455fbe20ef7dfc6c7d4d5.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_d707e279dc52dce8422e6968c5e2b817.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_d707e279dc52dce8422e6968c5e2b817.jpg already downloaded
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252Fb3%252F3cb32f11b8727bb20e405e7caef13cac%252Fpa%252FZL56858_05d4253c2901788d81d59d927abfe8a8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_05d4253c2901788d81d59d927abfe8a8.jpg already downloaded
2026-01-28 17:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7cf0badd-d420-570a-9f4b-40b69b46509c, identifier: ZL56858
2026-01-28 17:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: ce65c68e-315d-5d7e-90a8-b754598e35a5 with identifier: FX59239
2026-01-28 17:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: ce65c68e-315d-5d7e-90a8-b754598e35a5 with identifier: FX59239
2026-01-28 17:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: ce65c68e-315d-5d7e-90a8-b754598e35a5 with identifier: FX59239 to the API
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 69,
 'expiration_date': '2026-01-29T16:30:42Z',
 'fuel_type': 'petrol',
 'id': 'ce65c68e-315d-5d7e-90a8-b754598e35a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX59239',
 'listing': 'auction',
 'location': 'ES, Barcelona',
 'make': 'Fiat',
 'model': '500',
 'odometer': 27957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_8f1307bd62e7a7560a2e9bf165bb9b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3272bd4d1392686a321a61327b5f570c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_422003e384f2c686d8b9907978d6b23f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_7bbacb30ace58ccf0bd00881be027c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_f8adaa4a01c52aaa3cba5c5f4e4d769a.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_3f0643033f4281b0212aa48d70e9d5fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_849be41c65cc17a9c50c6b886ef13574.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5f83edaa180b9608da734a12f1f72477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_eeaa8cf298618cebe84fea1f917c0bce.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_5e6cab50b5c0a41035a1d58962a4c328.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_817b9785a22448354e1fba25cf374bd9.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a8c73e80879beea40f3de7857690246d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_40c090404850e2b58b3a4bbbdcb4cfdd.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_a1d03f008c9e7bf496cdee5dab16bf40.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce65c68e-315d-5d7e-90a8-b754598e35a5/ce65c68e-315d-5d7e-90a8-b754598e35a5_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/1a/891adbe82b402e64b5a71733e2255462/pa/FX59239_e1f2f26a1e30ad551825e7c33bdce1a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Rockstar',
 'transmission': 'manual',
 'trim': 'Rockstar',
 'year': 2020}
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27FX59239%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [auto1.es] INFO: Saving data for FX59239: {'created_time': 1769620267.602952, 'last_price_update_time': 1769620267.602963, 'auction_closing_time': 1769704242.0}
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='FX59239') HTTP/1.1" 204 0
2026-01-28 17:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7cf0badd-d420-570a-9f4b-40b69b46509c with identifier: ZL56858
2026-01-28 17:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7cf0badd-d420-570a-9f4b-40b69b46509c with identifier: ZL56858
2026-01-28 17:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
2026-01-28 17:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 7cf0badd-d420-570a-9f4b-40b69b46509c spider: auto1.es
2026-01-28 17:11:07 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 7cf0badd-d420-570a-9f4b-40b69b46509c due to rule: makes_models_not_allowed.json, error: Rejected due to make 'volkswagen' containing 'volkswagen' and model 'caddy' containing 'caddy'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-01-29T16:52:34Z',
 'fuel_type': 'diesel',
 'id': '7cf0badd-d420-570a-9f4b-40b69b46509c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL56858',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 189721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 18,
 'photo_urls': ['https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_cb8bbd5b8864afff6f2950aed99a02c0.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8007d33f6f8470f6fc004255265c1ff3.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_76f849556138d87edae4b17a836af5b4.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_03c317810e06852edb86aeef9250b4ed.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f3f556a16e204b9347b136c9e12c31be.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3a3eba16521232a8229286a530974eb9.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_74b835384a3ffdae9014217d79029afb.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_115dfe4a8b60bd51bea07f7ac074c654.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_250545f8428c52092a3be81c91038cb9.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_b689ea54b9ff9bf9ce41f3ec4eaabb96.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f9ca36f79ad0a094d3fdb4415f484276.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f2b3e15bfcc6c7dad674376b0b1bef86.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_13645dd78a57efb784336ba566c71b5b.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3d3b4e2d403861de5927a1582e27eb6e.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8fd9969b7155b23a96f329dd66d5a29c.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_ab5b436563a455fbe20ef7dfc6c7d4d5.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_d707e279dc52dce8422e6968c5e2b817.jpg',
                'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_05d4253c2901788d81d59d927abfe8a8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_cb8bbd5b8864afff6f2950aed99a02c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8007d33f6f8470f6fc004255265c1ff3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_76f849556138d87edae4b17a836af5b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_03c317810e06852edb86aeef9250b4ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f3f556a16e204b9347b136c9e12c31be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3a3eba16521232a8229286a530974eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_74b835384a3ffdae9014217d79029afb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_115dfe4a8b60bd51bea07f7ac074c654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_250545f8428c52092a3be81c91038cb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_b689ea54b9ff9bf9ce41f3ec4eaabb96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f9ca36f79ad0a094d3fdb4415f484276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_f2b3e15bfcc6c7dad674376b0b1bef86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_13645dd78a57efb784336ba566c71b5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_3d3b4e2d403861de5927a1582e27eb6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_8fd9969b7155b23a96f329dd66d5a29c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_ab5b436563a455fbe20ef7dfc6c7d4d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_d707e279dc52dce8422e6968c5e2b817.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7cf0badd-d420-570a-9f4b-40b69b46509c/7cf0badd-d420-570a-9f4b-40b69b46509c_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/b3/3cb32f11b8727bb20e405e7caef13cac/pa/ZL56858_05d4253c2901788d81d59d927abfe8a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi',
 'transmission': 'automatic',
 'trim': 'Maxi',
 'year': 2021}
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27ZL56858%27 HTTP/1.1" 200 None
2026-01-28 17:11:07 [auto1.es] INFO: Saving data for ZL56858: {'created_time': 1769620267.836888, 'last_price_update_time': 1769620267.836899, 'auction_closing_time': 1769705554.0}
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='ZL56858') HTTP/1.1" 204 0
2026-01-28 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN87696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WS16949> (referer: https://www.auto1.com/v1/car-details-view/WS16949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP36756> (referer: https://www.auto1.com/v1/car-details-view/TP36756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KY51908> (referer: https://www.auto1.com/v1/car-details-view/KY51908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BX26344> (referer: https://www.auto1.com/v1/car-details-view/BX26344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with identifier: WS16949
2026-01-28 17:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with scrape type 2
2026-01-28 17:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with scrape type 2
2026-01-28 17:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e, identifier: WS16949
2026-01-28 17:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 521692e4-44e4-56cb-9d89-aedbfdc9c860 with identifier: TP36756
2026-01-28 17:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 521692e4-44e4-56cb-9d89-aedbfdc9c860 with scrape type 1
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 521692e4-44e4-56cb-9d89-aedbfdc9c860
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_4448527d514e8e1d96639b8d3e1ec316.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_4448527d514e8e1d96639b8d3e1ec316.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_30fdf29d4d964042143d7255325eb5dc.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_30fdf29d4d964042143d7255325eb5dc.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_11838b1fa9f0c7ed9988f3db7c1b9b0c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_11838b1fa9f0c7ed9988f3db7c1b9b0c.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_e1edd3501372396ccacd570f1a1ec5f5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_e1edd3501372396ccacd570f1a1ec5f5.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_fd2135f7509232f2313ce83a7aa05270.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_fd2135f7509232f2313ce83a7aa05270.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_5784cb0bf1a1250a84e6e261a910c846.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_5784cb0bf1a1250a84e6e261a910c846.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_9ee619c09bf82bed4fd232480d5d64b7.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9ee619c09bf82bed4fd232480d5d64b7.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_9543035c249e81c926857b79546ba95a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9543035c249e81c926857b79546ba95a.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_43b0c2b171bc985e14c96204a4e67a99.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_43b0c2b171bc985e14c96204a4e67a99.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_461ad342cab62fbe4ed1f1ba5326aa53.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_461ad342cab62fbe4ed1f1ba5326aa53.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_1d8eeaf5730fa4fc5775931456c738a5.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_1d8eeaf5730fa4fc5775931456c738a5.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_a70fa1bf96d6661db7abb82315e0d25f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a70fa1bf96d6661db7abb82315e0d25f.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_bc78a281804be3b59908f68e4282aaad.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_bc78a281804be3b59908f68e4282aaad.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_81130889082bfafbce85ff90867a8031.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_81130889082bfafbce85ff90867a8031.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_dcb70d143cb16375762594cf04dbfb05.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_dcb70d143cb16375762594cf04dbfb05.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F89%252F43892e7abde4b665cf7f10c6f3d39650%252Fpa%252FTP36756_a65bd082c7dd705ba7e9206349cd1d5c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a65bd082c7dd705ba7e9206349cd1d5c.jpg already downloaded
2026-01-28 17:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 521692e4-44e4-56cb-9d89-aedbfdc9c860, identifier: TP36756
2026-01-28 17:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05fcd1dc-5c4c-5703-9f15-f03345a0034b with identifier: KY51908
2026-01-28 17:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05fcd1dc-5c4c-5703-9f15-f03345a0034b with scrape type 1
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 12 photos for item 05fcd1dc-5c4c-5703-9f15-f03345a0034b
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_11f03425b6e1585173b2d91d83967e4f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_11f03425b6e1585173b2d91d83967e4f.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_a290390993ff4b231692a4b88f9f3677.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_a290390993ff4b231692a4b88f9f3677.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_d7452cb8aca15aaf3d0770d995e21c1e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_d7452cb8aca15aaf3d0770d995e21c1e.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_b18a0928cc3bba1eee8f53000508fc82.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b18a0928cc3bba1eee8f53000508fc82.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_e04bcf77d6981f80af1de12fe6890268.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_e04bcf77d6981f80af1de12fe6890268.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_b0e17dba964ae7f68ce8af8c2051c2d9.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b0e17dba964ae7f68ce8af8c2051c2d9.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_514e1f6d2ce68d6a7811018e1d395d8c.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_514e1f6d2ce68d6a7811018e1d395d8c.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_81c5e43c92762dcc516225db5ae32a49.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_81c5e43c92762dcc516225db5ae32a49.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_ca0b3ddbd92cf29e7ae1bb84da7972e8.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_ca0b3ddbd92cf29e7ae1bb84da7972e8.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_bdee3abee41230fb4ffc58dd8919885e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bdee3abee41230fb4ffc58dd8919885e.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_bbad2ccad5d82a9f301c1d302a8e5125.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bbad2ccad5d82a9f301c1d302a8e5125.jpg already downloaded
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe8%252F5ce8d56e43fa1291978eb55276bc7fd1%252Fpa%252FKY51908_742c0bce8c52d222357b3b3b6f543d51.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_742c0bce8c52d222357b3b3b6f543d51.jpg already downloaded
2026-01-28 17:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 05fcd1dc-5c4c-5703-9f15-f03345a0034b, identifier: KY51908
2026-01-28 17:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with identifier: BX26344
2026-01-28 17:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with scrape type 2
2026-01-28 17:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with scrape type 2
2026-01-28 17:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 4b4376a0-1ce1-5596-80dd-8981b0f9e705, identifier: BX26344
2026-01-28 17:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with identifier: WS16949
2026-01-28 17:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with identifier: WS16949
2026-01-28 17:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4d7a56e7-59d2-5ed1-b1c6-decc7760c35e with identifier: WS16949 to the API
2026-01-28 17:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WS16949>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-01-29T16:11:11Z',
 'fuel_type': 'petrol',
 'id': '4d7a56e7-59d2-5ed1-b1c6-decc7760c35e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WS16949',
 'listing': 'auction',
 'location': 'ES, El Rebolledo (Alicante)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 55118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2023}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27WS16949%27 HTTP/1.1" 200 None
2026-01-28 17:11:09 [auto1.es] INFO: Saving data for WS16949: {'auction_closing_time': 1769703071.0, 'created_time': 1767780224.011902, 'last_price_update_time': 1769620269.189042}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='WS16949') HTTP/1.1" 204 0
2026-01-28 17:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 521692e4-44e4-56cb-9d89-aedbfdc9c860 with identifier: TP36756
2026-01-28 17:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 521692e4-44e4-56cb-9d89-aedbfdc9c860 with identifier: TP36756
2026-01-28 17:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 521692e4-44e4-56cb-9d89-aedbfdc9c860 with identifier: TP36756 to the API
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TP36756>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:00:55Z',
 'fuel_type': 'petrol',
 'id': '521692e4-44e4-56cb-9d89-aedbfdc9c860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP36756',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 134546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_4448527d514e8e1d96639b8d3e1ec316.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_30fdf29d4d964042143d7255325eb5dc.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_11838b1fa9f0c7ed9988f3db7c1b9b0c.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_e1edd3501372396ccacd570f1a1ec5f5.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_fd2135f7509232f2313ce83a7aa05270.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_5784cb0bf1a1250a84e6e261a910c846.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9ee619c09bf82bed4fd232480d5d64b7.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9543035c249e81c926857b79546ba95a.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_43b0c2b171bc985e14c96204a4e67a99.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_461ad342cab62fbe4ed1f1ba5326aa53.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_1d8eeaf5730fa4fc5775931456c738a5.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a70fa1bf96d6661db7abb82315e0d25f.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_bc78a281804be3b59908f68e4282aaad.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_81130889082bfafbce85ff90867a8031.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_dcb70d143cb16375762594cf04dbfb05.jpg',
                'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a65bd082c7dd705ba7e9206349cd1d5c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_4448527d514e8e1d96639b8d3e1ec316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_30fdf29d4d964042143d7255325eb5dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_11838b1fa9f0c7ed9988f3db7c1b9b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_e1edd3501372396ccacd570f1a1ec5f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_fd2135f7509232f2313ce83a7aa05270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_5784cb0bf1a1250a84e6e261a910c846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9ee619c09bf82bed4fd232480d5d64b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_9543035c249e81c926857b79546ba95a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_43b0c2b171bc985e14c96204a4e67a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_461ad342cab62fbe4ed1f1ba5326aa53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_1d8eeaf5730fa4fc5775931456c738a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a70fa1bf96d6661db7abb82315e0d25f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_bc78a281804be3b59908f68e4282aaad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_81130889082bfafbce85ff90867a8031.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_dcb70d143cb16375762594cf04dbfb05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_521692e4-44e4-56cb-9d89-aedbfdc9c860/521692e4-44e4-56cb-9d89-aedbfdc9c860_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/89/43892e7abde4b665cf7f10c6f3d39650/pa/TP36756_a65bd082c7dd705ba7e9206349cd1d5c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Design Luxe ultra',
 'transmission': 'automatic',
 'trim': 'Design Luxe ultra',
 'year': 2017}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27TP36756%27 HTTP/1.1" 200 None
2026-01-28 17:11:09 [auto1.es] INFO: Saving data for TP36756: {'created_time': 1769620269.579849, 'last_price_update_time': 1769620269.579859, 'auction_closing_time': 1769702455.0}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='TP36756') HTTP/1.1" 204 0
2026-01-28 17:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 05fcd1dc-5c4c-5703-9f15-f03345a0034b with identifier: KY51908
2026-01-28 17:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 05fcd1dc-5c4c-5703-9f15-f03345a0034b with identifier: KY51908
2026-01-28 17:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
2026-01-28 17:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 05fcd1dc-5c4c-5703-9f15-f03345a0034b spider: auto1.es
2026-01-28 17:11:09 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 05fcd1dc-5c4c-5703-9f15-f03345a0034b due to rule: makes_models_not_allowed.json, error: Rejected due to make 'fiat' containing 'fiat' and model 'doblo' containing 'doblo'
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-01-29T16:03:22Z',
 'fuel_type': 'diesel',
 'id': '05fcd1dc-5c4c-5703-9f15-f03345a0034b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY51908',
 'listing': 'auction',
 'location': 'ES',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 121702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 12,
 'photo_urls': ['https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_11f03425b6e1585173b2d91d83967e4f.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_a290390993ff4b231692a4b88f9f3677.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_d7452cb8aca15aaf3d0770d995e21c1e.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b18a0928cc3bba1eee8f53000508fc82.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_e04bcf77d6981f80af1de12fe6890268.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b0e17dba964ae7f68ce8af8c2051c2d9.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_514e1f6d2ce68d6a7811018e1d395d8c.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_81c5e43c92762dcc516225db5ae32a49.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_ca0b3ddbd92cf29e7ae1bb84da7972e8.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bdee3abee41230fb4ffc58dd8919885e.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bbad2ccad5d82a9f301c1d302a8e5125.jpg',
                'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_742c0bce8c52d222357b3b3b6f543d51.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 319164,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_11f03425b6e1585173b2d91d83967e4f.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67255,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_a290390993ff4b231692a4b88f9f3677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 262915,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_d7452cb8aca15aaf3d0770d995e21c1e.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55122,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b18a0928cc3bba1eee8f53000508fc82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 244252,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_e04bcf77d6981f80af1de12fe6890268.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67255,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_b0e17dba964ae7f68ce8af8c2051c2d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62973,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_514e1f6d2ce68d6a7811018e1d395d8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 306898,
             'Height': 503,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_81c5e43c92762dcc516225db5ae32a49.jpg',
             'Width': 894},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53591,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_ca0b3ddbd92cf29e7ae1bb84da7972e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53591,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bdee3abee41230fb4ffc58dd8919885e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 218366,
             'Height': 465,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_bbad2ccad5d82a9f301c1d302a8e5125.jpg',
             'Width': 826},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05fcd1dc-5c4c-5703-9f15-f03345a0034b/05fcd1dc-5c4c-5703-9f15-f03345a0034b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43394,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e8/5ce8d56e43fa1291978eb55276bc7fd1/pa/KY51908_742c0bce8c52d222357b3b3b6f543d51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-04-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.3 M-Jet Furgón',
 'transmission': 'manual',
 'trim': 'Furgón',
 'year': 2021}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KY51908%27 HTTP/1.1" 200 None
2026-01-28 17:11:09 [auto1.es] INFO: Saving data for KY51908: {'created_time': 1769620269.807452, 'last_price_update_time': 1769620269.807464, 'auction_closing_time': 1769702602.0}
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KY51908') HTTP/1.1" 204 0
2026-01-28 17:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with identifier: BX26344
2026-01-28 17:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with identifier: BX26344
2026-01-28 17:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 4b4376a0-1ce1-5596-80dd-8981b0f9e705 with identifier: BX26344 to the API
2026-01-28 17:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BX26344>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:48:07Z',
 'fuel_type': 'diesel',
 'id': '4b4376a0-1ce1-5596-80dd-8981b0f9e705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX26344',
 'listing': 'auction',
 'location': 'ES, Sevilla',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 110381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-01-28 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27BX26344%27 HTTP/1.1" 200 None
2026-01-28 17:11:10 [auto1.es] INFO: Saving data for BX26344: {'auction_closing_time': 1769705287.0, 'created_time': 1769162577.005948, 'last_price_update_time': 1769620270.244092}
2026-01-28 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='BX26344') HTTP/1.1" 204 0
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC75977> (referer: https://www.auto1.com/v1/car-details-view/LC75977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ95887> (referer: https://www.auto1.com/v1/car-details-view/KJ95887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX86419> (referer: https://www.auto1.com/v1/car-details-view/PX86419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d210efe-288d-5051-b40e-27e21cfc4907 with identifier: LC75977
2026-01-28 17:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d210efe-288d-5051-b40e-27e21cfc4907 with scrape type 1
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 16 photos for item 2d210efe-288d-5051-b40e-27e21cfc4907
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_3c6f981001accc06728d8e9b14231e2a.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_3c6f981001accc06728d8e9b14231e2a.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_9c7418e62f4f6c51a98ff8c03185988e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_9c7418e62f4f6c51a98ff8c03185988e.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_63ac9f22715c9ac116fd491b789d8ac0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_63ac9f22715c9ac116fd491b789d8ac0.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_ad3ac2d7d42af7d04442099c69279251.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_ad3ac2d7d42af7d04442099c69279251.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_6901cbe60a71285c54bf038cbbf81017.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_6901cbe60a71285c54bf038cbbf81017.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_b2e56efdee68cc2975842cc6078838fb.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_b2e56efdee68cc2975842cc6078838fb.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_addcd3526794db23211841af8164a1ef.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_addcd3526794db23211841af8164a1ef.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_5a58b4c307b803964eb5df70605a2108.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_5a58b4c307b803964eb5df70605a2108.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_65016aef5f64590bd8a0278865d7b4de.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_65016aef5f64590bd8a0278865d7b4de.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_bd230acdfa0f5d8dc7c9ebc287396bca.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_bd230acdfa0f5d8dc7c9ebc287396bca.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_40219bd66fababb47ef0ed44fecb184f.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_40219bd66fababb47ef0ed44fecb184f.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_03e1967dea1cec543b28fb92cfecc9a0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_03e1967dea1cec543b28fb92cfecc9a0.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_7b7007de3729235383470c02e2613ed2.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_7b7007de3729235383470c02e2613ed2.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_20569e966c19ed0e635b0c47386b9d6e.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_20569e966c19ed0e635b0c47386b9d6e.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_2ba0251a2e5373e9e2bdbe6aafde27c0.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_2ba0251a2e5373e9e2bdbe6aafde27c0.jpg already downloaded
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F37%252Fb337c82cdb40ce73a2751b2712a2f398%252Fpa%252FLC75977_60fbe36040837710d529029a257ea9f1.jpg%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_60fbe36040837710d529029a257ea9f1.jpg already downloaded
2026-01-28 17:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 2d210efe-288d-5051-b40e-27e21cfc4907, identifier: LC75977
2026-01-28 17:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 2d210efe-288d-5051-b40e-27e21cfc4907 with identifier: LC75977
2026-01-28 17:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 2d210efe-288d-5051-b40e-27e21cfc4907 with identifier: LC75977
2026-01-28 17:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 194319 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194319
2026-01-28 17:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2d210efe-288d-5051-b40e-27e21cfc4907 spider: auto1.es
2026-01-28 17:11:11 [scrapy.core.scraper] INFO: Dropped: Spider: auto1.es, Dropping listing: 2d210efe-288d-5051-b40e-27e21cfc4907 due to rule: high_mileage_for_country.json, error: 194319 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][1]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    194319
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-01-29T16:03:45Z',
 'fuel_type': 'petrol',
 'id': '2d210efe-288d-5051-b40e-27e21cfc4907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC75977',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 194319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_3c6f981001accc06728d8e9b14231e2a.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_9c7418e62f4f6c51a98ff8c03185988e.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_63ac9f22715c9ac116fd491b789d8ac0.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_ad3ac2d7d42af7d04442099c69279251.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_6901cbe60a71285c54bf038cbbf81017.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_b2e56efdee68cc2975842cc6078838fb.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_addcd3526794db23211841af8164a1ef.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_5a58b4c307b803964eb5df70605a2108.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_65016aef5f64590bd8a0278865d7b4de.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_bd230acdfa0f5d8dc7c9ebc287396bca.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_40219bd66fababb47ef0ed44fecb184f.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_03e1967dea1cec543b28fb92cfecc9a0.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_7b7007de3729235383470c02e2613ed2.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_20569e966c19ed0e635b0c47386b9d6e.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_2ba0251a2e5373e9e2bdbe6aafde27c0.jpg',
                'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_60fbe36040837710d529029a257ea9f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59273,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_3c6f981001accc06728d8e9b14231e2a.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 337997,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_9c7418e62f4f6c51a98ff8c03185988e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 332931,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_63ac9f22715c9ac116fd491b789d8ac0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48839,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_ad3ac2d7d42af7d04442099c69279251.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52918,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_6901cbe60a71285c54bf038cbbf81017.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51819,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_b2e56efdee68cc2975842cc6078838fb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284072,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_addcd3526794db23211841af8164a1ef.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_5a58b4c307b803964eb5df70605a2108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56290,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_65016aef5f64590bd8a0278865d7b4de.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44502,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_bd230acdfa0f5d8dc7c9ebc287396bca.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_40219bd66fababb47ef0ed44fecb184f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_03e1967dea1cec543b28fb92cfecc9a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_7b7007de3729235383470c02e2613ed2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_20569e966c19ed0e635b0c47386b9d6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_2ba0251a2e5373e9e2bdbe6aafde27c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d210efe-288d-5051-b40e-27e21cfc4907/2d210efe-288d-5051-b40e-27e21cfc4907_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/37/b337c82cdb40ce73a2751b2712a2f398/pa/LC75977_60fbe36040837710d529029a257ea9f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.0 Turbo Super Q4',
 'transmission': 'automatic',
 'trim': 'Super Q4',
 'year': 2018}
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27LC75977%27 HTTP/1.1" 200 None
2026-01-28 17:11:11 [auto1.es] INFO: Saving data for LC75977: {'created_time': 1769620271.72579, 'last_price_update_time': 1769620271.725801, 'auction_closing_time': 1769702625.0}
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='LC75977') HTTP/1.1" 204 0
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YY25226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM67211> (referer: https://www.auto1.com/v1/car-details-view/YM67211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CU12578> (referer: https://www.auto1.com/v1/car-details-view/CU12578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with identifier: KJ95887
2026-01-28 17:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with scrape type 2
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with scrape type 2
2026-01-28 17:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6ec43712-9bee-5ef4-bdbb-cc6552253cb6, identifier: KJ95887
2026-01-28 17:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with identifier: PX86419
2026-01-28 17:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with scrape type 2
2026-01-28 17:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with scrape type 2
2026-01-28 17:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15, identifier: PX86419
2026-01-28 17:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with identifier: KJ95887
2026-01-28 17:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with identifier: KJ95887
2026-01-28 17:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6ec43712-9bee-5ef4-bdbb-cc6552253cb6 with identifier: KJ95887 to the API
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KJ95887>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 106,
 'expiration_date': '2026-01-29T16:58:02Z',
 'fuel_type': 'petrol',
 'id': '6ec43712-9bee-5ef4-bdbb-cc6552253cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ95887',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 46216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MG ZS 1.5 VTi Luxury',
 'transmission': 'manual',
 'trim': 'Luxury',
 'year': 2022}
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27KJ95887%27 HTTP/1.1" 200 None
2026-01-28 17:11:12 [auto1.es] INFO: Saving data for KJ95887: {'auction_closing_time': 1769705882.0, 'created_time': 1768824957.665555, 'last_price_update_time': 1769620272.236166}
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='KJ95887') HTTP/1.1" 204 0
2026-01-28 17:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with identifier: PX86419
2026-01-28 17:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with identifier: PX86419
2026-01-28 17:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ee7e8f2-4a13-5a32-bc2e-3accf609bb15 with identifier: PX86419 to the API
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX86419>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-01-29T16:40:08Z',
 'fuel_type': 'petrol',
 'id': '7ee7e8f2-4a13-5a32-bc2e-3accf609bb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX86419',
 'listing': 'auction',
 'location': 'ES, El Prat de Llobregat (Barcelona)',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 102228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PX86419%27 HTTP/1.1" 200 None
2026-01-28 17:11:12 [auto1.es] INFO: Saving data for PX86419: {'auction_closing_time': 1769704808.0, 'created_time': 1765886975.030099, 'last_price_update_time': 1769620272.556343}
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PX86419') HTTP/1.1" 204 0
2026-01-28 17:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PZ78942> (referer: https://www.auto1.com/v1/car-details-view/PZ78942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 635e1f28-87fb-5f46-8665-8b2e52a42b05 with identifier: YM67211
2026-01-28 17:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 635e1f28-87fb-5f46-8665-8b2e52a42b05 with scrape type 2
2026-01-28 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 635e1f28-87fb-5f46-8665-8b2e52a42b05 with scrape type 2
2026-01-28 17:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 635e1f28-87fb-5f46-8665-8b2e52a42b05, identifier: YM67211
2026-01-28 17:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ab008d-886b-5c15-9451-b42c03eefb9d with identifier: CU12578
2026-01-28 17:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ab008d-886b-5c15-9451-b42c03eefb9d with scrape type 2
2026-01-28 17:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ab008d-886b-5c15-9451-b42c03eefb9d with scrape type 2
2026-01-28 17:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: e8ab008d-886b-5c15-9451-b42c03eefb9d, identifier: CU12578
2026-01-28 17:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 635e1f28-87fb-5f46-8665-8b2e52a42b05 with identifier: YM67211
2026-01-28 17:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 635e1f28-87fb-5f46-8665-8b2e52a42b05 with identifier: YM67211
2026-01-28 17:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 635e1f28-87fb-5f46-8665-8b2e52a42b05 with identifier: YM67211 to the API
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YM67211>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-01-29T16:00:48Z',
 'fuel_type': 'diesel',
 'id': '635e1f28-87fb-5f46-8665-8b2e52a42b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM67211',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 102770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Advanced edition',
 'transmission': 'automatic',
 'trim': 'quattro Advanced edition',
 'year': 2017}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YM67211%27 HTTP/1.1" 200 None
2026-01-28 17:11:13 [auto1.es] INFO: Saving data for YM67211: {'auction_closing_time': 1769702448.0, 'created_time': 1766586392.028514, 'last_price_update_time': 1769620273.052928}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YM67211') HTTP/1.1" 204 0
2026-01-28 17:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: e8ab008d-886b-5c15-9451-b42c03eefb9d with identifier: CU12578
2026-01-28 17:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: e8ab008d-886b-5c15-9451-b42c03eefb9d with identifier: CU12578
2026-01-28 17:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: e8ab008d-886b-5c15-9451-b42c03eefb9d with identifier: CU12578 to the API
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CU12578>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 67,
 'expiration_date': '2026-01-29T16:23:43Z',
 'fuel_type': 'petrol',
 'id': 'e8ab008d-886b-5c15-9451-b42c03eefb9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU12578',
 'listing': 'auction',
 'location': 'ES, El Carpio',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 33893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2019}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27CU12578%27 HTTP/1.1" 200 None
2026-01-28 17:11:13 [auto1.es] INFO: Saving data for CU12578: {'auction_closing_time': 1769703823.0, 'created_time': 1769014822.579837, 'last_price_update_time': 1769620273.355562}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='CU12578') HTTP/1.1" 204 0
2026-01-28 17:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 17:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD94145> (referer: https://www.auto1.com/v1/car-details-view/YD94145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd85c04-98df-5e53-9932-e08cb635d6a7 with identifier: PZ78942
2026-01-28 17:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd85c04-98df-5e53-9932-e08cb635d6a7 with scrape type 2
2026-01-28 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fd85c04-98df-5e53-9932-e08cb635d6a7 with scrape type 2
2026-01-28 17:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 6fd85c04-98df-5e53-9932-e08cb635d6a7, identifier: PZ78942
2026-01-28 17:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 6fd85c04-98df-5e53-9932-e08cb635d6a7 with identifier: PZ78942
2026-01-28 17:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 6fd85c04-98df-5e53-9932-e08cb635d6a7 with identifier: PZ78942
2026-01-28 17:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 6fd85c04-98df-5e53-9932-e08cb635d6a7 with identifier: PZ78942 to the API
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PZ78942>
{'auction_title': '',
 'c_o_2_emission_value': 100,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-01-29T16:42:19Z',
 'fuel_type': 'hybrid',
 'id': '6fd85c04-98df-5e53-9932-e08cb635d6a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ78942',
 'listing': 'auction',
 'location': 'ES, ESQUIVIAS',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 43934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-09-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Active Tech',
 'transmission': 'automatic',
 'trim': '2WD Active Tech',
 'year': 2023}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27PZ78942%27 HTTP/1.1" 200 None
2026-01-28 17:11:13 [auto1.es] INFO: Saving data for PZ78942: {'auction_closing_time': 1769704939.0, 'created_time': 1768669255.207977, 'last_price_update_time': 1769620273.863088}
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='PZ78942') HTTP/1.1" 204 0
2026-01-28 17:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN87696> (referer: https://www.auto1.com/v1/car-details-view/UN87696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with identifier: YD94145
2026-01-28 17:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with scrape type 2
2026-01-28 17:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with scrape type 2
2026-01-28 17:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: 7ef0c696-c0c2-5465-ba39-e0a4935e55eb, identifier: YD94145
2026-01-28 17:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with identifier: YD94145
2026-01-28 17:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with identifier: YD94145
2026-01-28 17:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: 7ef0c696-c0c2-5465-ba39-e0a4935e55eb with identifier: YD94145 to the API
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YD94145>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 115,
 'expiration_date': '2026-01-29T16:22:31Z',
 'fuel_type': 'diesel',
 'id': '7ef0c696-c0c2-5465-ba39-e0a4935e55eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD94145',
 'listing': 'auction',
 'location': 'ES, Hellin',
 'make': 'BMW',
 'model': '1er',
 'odometer': 78605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2019}
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YD94145%27 HTTP/1.1" 200 None
2026-01-28 17:11:14 [auto1.es] INFO: Saving data for YD94145: {'auction_closing_time': 1769703751.0, 'created_time': 1767805601.785933, 'last_price_update_time': 1769620274.428694}
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YD94145') HTTP/1.1" 204 0
2026-01-28 17:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with identifier: UN87696
2026-01-28 17:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with scrape type 2
2026-01-28 17:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with scrape type 2
2026-01-28 17:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: eaf96c2f-519b-5fce-9f88-128fcbfa3dcc, identifier: UN87696
2026-01-28 17:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with identifier: UN87696
2026-01-28 17:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with identifier: UN87696
2026-01-28 17:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: eaf96c2f-519b-5fce-9f88-128fcbfa3dcc with identifier: UN87696 to the API
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UN87696>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 204,
 'expiration_date': '2026-01-29T16:36:39Z',
 'fuel_type': 'hybrid',
 'id': 'eaf96c2f-519b-5fce-9f88-128fcbfa3dcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN87696',
 'listing': 'auction',
 'location': 'ES, Madrid',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 45704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-10-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan X-Trail 1.5 VC-T e-POWER N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2023}
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27UN87696%27 HTTP/1.1" 200 None
2026-01-28 17:11:14 [auto1.es] INFO: Saving data for UN87696: {'auction_closing_time': 1769704599.0, 'created_time': 1768975303.748257, 'last_price_update_time': 1769620274.916104}
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='UN87696') HTTP/1.1" 204 0
2026-01-28 17:11:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YY25226> (referer: https://www.auto1.com/v1/car-details-view/YY25226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-01-28 17:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4cb835f-61e9-5737-9a02-efd91e71961d with identifier: YY25226
2026-01-28 17:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4cb835f-61e9-5737-9a02-efd91e71961d with scrape type 2
2026-01-28 17:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4cb835f-61e9-5737-9a02-efd91e71961d with scrape type 2
2026-01-28 17:11:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.es, Processed item id: a4cb835f-61e9-5737-9a02-efd91e71961d, identifier: YY25226
2026-01-28 17:11:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.es, Translating item: a4cb835f-61e9-5737-9a02-efd91e71961d with identifier: YY25226
2026-01-28 17:11:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.es, Applying rules to item: a4cb835f-61e9-5737-9a02-efd91e71961d with identifier: YY25226
2026-01-28 17:11:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.es, Posting item: a4cb835f-61e9-5737-9a02-efd91e71961d with identifier: YY25226 to the API
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 17:11:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YY25226>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-01-29T16:00:26Z',
 'fuel_type': 'petrol',
 'id': 'a4cb835f-61e9-5737-9a02-efd91e71961d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY25226',
 'listing': 'auction',
 'location': 'ES, Calaf - Barcelona',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 60463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'ES',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20RowKey%20eq%20%27YY25226%27 HTTP/1.1" 200 None
2026-01-28 17:11:16 [auto1.es] INFO: Saving data for YY25226: {'auction_closing_time': 1769702426.0, 'created_time': 1769421690.16317, 'last_price_update_time': 1769620276.385863}
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.es',RowKey='YY25226') HTTP/1.1" 204 0
2026-01-28 17:11:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 17:11:16 [auto1.es] INFO: auto1.es Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.es%27%20and%20last_price_update_time%20lt%201769188276 HTTP/1.1" 200 None
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AH50824') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='AT30905') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='BR74891') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CB81933') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CH60338') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='CS76326') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='DG38889') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='EN68116') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ER88031') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='FY49686') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HC55610') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HH01750') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='HH41017') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JL96031') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='JP19780') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KB93146') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='KS50263') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='LB29126') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='MC59765') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NA18887') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ02942') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NJ73510') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='NW08960') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RH53002') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RL59399') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RP10219') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='RR20256') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='SM86300') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TA86003') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TC11503') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TJ56817') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TM91027') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='TX98540') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='UE14624') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='VE75374') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WA18614') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WE12630') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WJ47895') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WK11065') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WR71493') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='WZ08147') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XF08625') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='XM26564') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG05635') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG56560') HTTP/1.1" 204 0
2026-01-28 17:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZG79157') HTTP/1.1" 204 0
2026-01-28 17:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.es',RowKey='ZY64818') HTTP/1.1" 204 0
2026-01-28 17:11:17 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (377 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.es/task_25_2026-01-28T17_00_00.jl
2026-01-28 17:11:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 4240512,
 'downloader/request_count': 2304,
 'downloader/request_method_count/GET': 2276,
 'downloader/request_method_count/POST': 28,
 'downloader/response_bytes': 153891826,
 'downloader/response_count': 2304,
 'downloader/response_status_count/200': 2304,
 'dupefilter/filtered': 22,
 'elapsed_time_seconds': 672.402498,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 1, 28, 17, 11, 17, 1161, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 281,
 'item_dropped_reasons_count/DropItem': 281,
 'item_scraped_count': 377,
 'log_count/DEBUG': 19994,
 'log_count/ERROR': 6,
 'log_count/INFO': 17653,
 'memusage/max': 170225664,
 'memusage/startup': 126902272,
 'photo_download_count': 958,
 'request_depth_max': 30,
 'response_received_count': 1346,
 'scheduler/dequeued': 2304,
 'scheduler/dequeued/memory': 2304,
 'scheduler/enqueued': 2304,
 'scheduler/enqueued/memory': 2304,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 1346,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.479079463232012,
 'scrapy-zyte-api/mean_response_seconds': 3.4918044991037087,
 'scrapy-zyte-api/processed': 1346,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 1346,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 1345,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 1346,
 'scrapy-zyte-api/request_args/httpRequestBody': 28,
 'scrapy-zyte-api/request_args/httpRequestMethod': 28,
 'scrapy-zyte-api/request_args/httpResponseBody': 1346,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 1346,
 'scrapy-zyte-api/request_args/sessionContext': 1346,
 'scrapy-zyte-api/request_args/url': 1346,
 'scrapy-zyte-api/status_codes/200': 1346,
 'scrapy-zyte-api/success': 1346,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2026, 1, 28, 17, 0, 4, 598663, tzinfo=datetime.timezone.utc)}
2026-01-28 17:11:17 [scrapy.core.engine] INFO: Spider closed (finished)
2026-01-28 17:11:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4b698dc610>
2026-01-28 17:11:17 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f4b694a5090>